Jul 24 15:36:30 devstack cinder-volume[77301]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 24 15:36:30 devstack cinder-volume[77301]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 15:36:30 devstack cinder-volume[77301]: we strongly recommend against using it for new projects. Jul 24 15:36:30 devstack cinder-volume[77301]: If you are already using Eventlet, we recommend migrating to a different Jul 24 15:36:30 devstack cinder-volume[77301]: framework. For more detail see Jul 24 15:36:30 devstack cinder-volume[77301]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 15:36:30 devstack cinder-volume[77301]: import eventlet # noqa Jul 24 15:36:33 devstack cinder-volume[77301]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 15:36:33 devstack cinder-volume[77301]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 15:36:33 devstack cinder-volume[77301]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 15:36:34 devstack cinder-volume[77301]: INFO dbcounter [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Registered counter for database cinder Jul 24 15:36:34 devstack cinder-volume[77301]: DEBUG oslo_db.sqlalchemy.engines [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:36:34 devstack cinder-volume[77301]: DEBUG dbcounter [-] [77301] Writer thread running {{(pid=77301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 15:36:34 devstack cinder-volume[77301]: INFO cinder.rpc [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 24 15:36:34 devstack cinder-volume[77301]: INFO cinder.rpc [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 24 15:36:34 devstack cinder-volume[77301]: DEBUG oslo_db.sqlalchemy.engines [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:36:34 devstack cinder-volume[77301]: INFO cinder.volume.manager [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Determined volume DB was empty at startup. Jul 24 15:36:34 devstack cinder-volume[77301]: DEBUG cinder.volume.manager [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77301) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 24 15:36:34 devstack cinder-volume[77301]: INFO cinder.volume.manager [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 24 15:36:34 devstack cinder-volume[77301]: WARNING stevedore.named [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 15:36:34 devstack cinder-volume[77301]: WARNING castellan.key_manager [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 15:36:34 devstack cinder-volume[77301]: WARNING cinder.keymgr.conf_key_mgr [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 15:36:34 devstack cinder-volume[77301]: DEBUG cinder.volume.drivers.lvm [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77301) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Jul 24 15:36:34 devstack cinder-volume[77301]: DEBUG oslo_concurrency.processutils [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_concurrency.processutils [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] CMD "cinder-rtstool verify" returned: 0 in 0.473s {{(pid=77301) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_db.sqlalchemy.engines [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:36:35 devstack cinder-volume[77301]: INFO cinder.rpc [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 24 15:36:35 devstack cinder-volume[77301]: INFO cinder.rpc [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 24 15:36:35 devstack cinder-volume[77301]: WARNING stevedore.named [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 15:36:35 devstack cinder-volume[77301]: WARNING castellan.key_manager [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 15:36:35 devstack cinder-volume[77301]: INFO cinder.volume.manager [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_db.sqlalchemy.engines [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77301) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:36:35 devstack cinder-volume[77301]: INFO oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Starting 1 workers Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Started child 77517 {{(pid=77301) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Full set of CONF: {{(pid=77301) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] ******************************************************************************** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Configuration options gathered from: {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] ================================================================================ {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] allow_availability_zone_fallback = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] allow_compression_on_image_upload = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] allowed_direct_url_schemes = [] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] api_rate_limit = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] auth_strategy = keystone {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] az_cache_duration = 3600 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77517]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_availability_zone = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_host = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_name = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_stats_polling_interval = 60 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backup_api_class = cinder.backup.api.API {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backup_name_template = backup-%s {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backup_use_same_host = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backup_use_temp_snapshot = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] chap_password = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] chap_username = {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cinder_internal_tenant_project_id = 3d377a87b8e74e0cbbe32ac5131ecbe9 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cinder_internal_tenant_user_id = f6bebd750e87471c9cd003bd55fb11ef {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cloned_volume_same_az = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cluster = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] compression_format = gzip {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] compute_api_class = cinder.compute.nova.API {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] config_dir = [] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] config_source = [] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] control_exchange = openstack {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] debug = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] default_availability_zone = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] default_group_type = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] default_volume_type = lvmdriver-1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] disk_geometry = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] driver_client_cert = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] driver_client_cert_key = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] driver_data_namespace = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] driver_ssl_cert_path = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] driver_ssl_cert_verify = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] driver_use_ssl = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] enable_force_upload = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] enable_new_services = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] enable_unsupported_driver = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] enforce_multipath_for_image_xfer = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] filter_function = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance_api_insecure = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance_api_servers = ['http://192.168.122.187/image'] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance_api_ssl_compression = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance_ca_certificates_file = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance_catalog_info = image:glance:publicURL {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance_certfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance_keyfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance_num_retries = 3 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance_request_timeout = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] goodness_function = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] graceful_shutdown_timeout = 5 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] group_api_class = cinder.group.api.API {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] host = devstack {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] image_compress_on_upload = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] image_conversion_address_space_limit = 1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] image_conversion_cpu_limit = 60 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] image_conversion_disable = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] image_upload_use_cinder_backend = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] image_upload_use_internal_tenant = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] image_volume_cache_enabled = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] image_volume_cache_max_count = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] image_volume_cache_max_size_gb = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] init_host_max_objects_retrieval = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] instance_format = [instance: %(uuid)s] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77517]: INFO cinder.volume.manager [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] iscsi_target_flags = {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] iscsi_write_cache = on {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] iser_helper = tgtadm {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] iser_ip_address = 192.168.122.187 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] iser_port = 3260 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] log_color = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] log_config_append = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] log_dir = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] log_file = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] log_options = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] log_rotate_interval = 1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] log_rotate_interval_type = days {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] log_rotation_type = none {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] max_age = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] max_logfile_count = 30 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] max_logfile_size_mb = 200 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] max_over_subscription_ratio = 20.0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] message_reap_interval = 86400 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] message_ttl = 2592000 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] migration_create_volume_timeout_secs = 300 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] monkey_patch = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] monkey_patch_modules = [] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] my_ip = 192.168.122.187 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] no_snapshot_gb_quota = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] num_iser_scan_tries = 3 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] num_shell_tries = 3 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] num_volume_device_scan_tries = 3 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] nvmeof_conn_info_version = 1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] nvmet_ns_id = 10 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] nvmet_port_id = 1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] osapi_max_limit = 1000 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] osapi_volume_ext_list = [] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] osapi_volume_listen_port = 8776 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] osapi_volume_use_ssl = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] osapi_volume_workers = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] per_volume_size_limit = -1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] periodic_fuzzy_delay = 60 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] periodic_interval = 60 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] public_endpoint = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] publish_errors = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] quota_backup_gigabytes = 1000 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] quota_backups = 10 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] quota_gigabytes = 1000 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] quota_groups = 10 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] quota_snapshots = 10 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] quota_volumes = 10 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] rate_limit_burst = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] rate_limit_except_level = CRITICAL {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] rate_limit_interval = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] reinit_driver_count = 3 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] replication_device = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] report_discard_supported = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] report_interval = 120 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] reservation_clean_interval = 86400 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] reservation_expire = 86400 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] reserved_image_namespaces = [] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] reserved_percentage = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] rpc_response_timeout = 120 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] run_external_periodic_tasks = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] scst_target_driver = iscsi {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] scst_target_iqn_name = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] service_down_time = 720 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] shell_completion = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] snapshot_name_template = snapshot-%s {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] snapshot_same_host = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] split_loggers = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] state_path = /opt/stack/data/cinder {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] storage_availability_zone = nova {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] storage_protocol = iSCSI {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] syslog_log_facility = LOG_USER {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] target_helper = lioadm {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] target_ip_address = 192.168.122.187 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] target_port = 3260 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] target_protocol = iscsi {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] target_secondary_ip_addresses = [] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] trace_flags = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] transport_url = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] until_refresh = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] use_chap_auth = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] use_default_quota_class = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] use_journal = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] use_json = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] use_multipath_for_image_xfer = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] use_stderr = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] use_syslog = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] verify_glance_signatures = enabled {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] volume_api_class = cinder.volume.api.API {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] volume_backend_name = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] volume_clear = zero {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] volume_clear_ionice = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] volume_clear_size = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] volume_copy_bps_limit = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] volume_dd_blocksize = 1M {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] volume_name_template = volume-%s {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] volume_service_inithost_offload = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] volume_usage_audit_period = month {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] zoning_mode = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_concurrency.disable_process_locking = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.auth_section = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.auth_type = password {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.auth_version = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.cache = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.certfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.include_service_catalog = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.insecure = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.interface = public {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.keyfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_password = {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcache_username = {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.region_name = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.service_type = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.187/identity {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.backend = dogpile.cache.null {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.backend_argument = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.backend_expiration_time = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.config_prefix = cache.oslo {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.debug_cache_backend = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.enable_retry_client = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.enable_socket_keepalive = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.enabled = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.expiration_time = 600 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.hashclient_retry_attempts = 2 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.memcache_dead_retry = 300 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.memcache_pool_maxsize = 10 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.memcache_sasl_enabled = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.password = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.proxies = [] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.redis_db = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.redis_server = localhost:6379 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.retry_attempts = 2 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.retry_delay = 0.0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.socket_keepalive_count = 1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.socket_keepalive_idle = 1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.socket_keepalive_interval = 1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.socket_timeout = 1.0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.tls_allowed_ciphers = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.tls_cafile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.tls_certfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.tls_enabled = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.tls_keyfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cache.username = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] coordination.backend_url = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.asyncio_connection = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.asyncio_slave_connection = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.backend = sqlalchemy {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.connection = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.connection_debug = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.connection_parameters = {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.connection_recycle_time = 3600 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.connection_trace = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.db_inc_retry_interval = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.db_max_retries = 20 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.db_max_retry_interval = 10 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.db_retry_interval = 1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.max_overflow = 50 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.max_pool_size = 5 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.max_retries = 10 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.mysql_wsrep_sync_wait = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.pool_timeout = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.retry_interval = 10 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.slave_connection = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.sqlite_synchronous = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.synchronous_reader = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] database.use_db_reconnect = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] profiler.connection_string = messaging:// {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] profiler.enabled = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] profiler.es_doc_type = notification {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] profiler.es_scroll_size = 10000 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] profiler.es_scroll_time = 2m {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] profiler.filter_error_trace = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] profiler.hmac_keys = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] profiler.sentinel_service_name = mymaster {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] profiler.socket_timeout = 0.1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] profiler.trace_requests = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] profiler.trace_sqlalchemy = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] profiler_jaeger.process_tags = {} {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] profiler_jaeger.service_name_prefix = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] profiler_otlp.service_name_prefix = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_policy.enforce_new_defaults = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_policy.policy_default_rule = default {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_policy.policy_file = policy.yaml {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] privsep_osbrick.group = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] privsep_osbrick.helper_command = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] privsep_osbrick.user = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cinder_sys_admin.group = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cinder_sys_admin.helper_command = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] cinder_sys_admin.user = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] service_user.auth_section = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] service_user.auth_type = password {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] service_user.cafile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] service_user.certfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] service_user.collect_timing = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] service_user.insecure = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] service_user.keyfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] service_user.send_service_user_token = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] service_user.split_loggers = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] service_user.timeout = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance.auth_section = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance.auth_type = password {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance.certfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance.collect_timing = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance.insecure = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance.keyfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance.region_name = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance.split_loggers = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] glance.timeout = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.backend_availability_zone = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.chap_password = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.chap_username = {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack sudo[77559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 24 15:36:35 devstack sudo[77559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.disk_geometry = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.driver_client_cert = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.driver_client_cert_key = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.driver_data_namespace = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.driver_use_ssl = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.extra_capabilities = {} {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.filter_function = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.goodness_function = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.iscsi_target_flags = {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.iscsi_write_cache = on {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.iser_helper = tgtadm {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.iser_ip_address = 192.168.122.187 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.iser_port = 3260 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.lvm_share_target = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.lvm_type = auto {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.num_shell_tries = 3 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.replication_device = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.report_discard_supported = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.reserved_percentage = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.target_helper = tgtadm {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.target_ip_address = 192.168.122.187 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.target_port = 3260 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.target_protocol = iscsi {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.trace_flags = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.unique_fqdn_network = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.use_chap_auth = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.volume_backend_name = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.volume_clear = zero {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.volume_clear_ionice = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.volume_clear_size = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_reports.file_event_handler = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_reports.log_dir = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.backend_host = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.chap_password = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.chap_username = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.disk_geometry = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.driver_client_cert = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.extra_capabilities = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.filter_function = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.goodness_function = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.iser_helper = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.iser_ip_address = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.iser_port = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.lvm_share_target = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.lvm_type = auto {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.num_shell_tries = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.replication_device = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.report_discard_supported = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.reserved_percentage = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.scst_target_driver = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.storage_protocol = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.target_helper = lioadm {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.target_ip_address = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.target_port = 3260 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.trace_flags = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.use_chap_auth = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.volume_clear = zero {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.volume_clear_size = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] lvmdriver-1.volumes_dir = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.ssl = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_notifications.driver = [] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_notifications.retry = -1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] key_manager.fixed_key = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.barbican_api_version = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.barbican_endpoint = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.barbican_endpoint_type = public {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.barbican_region_name = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.cafile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.certfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.collect_timing = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.insecure = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.keyfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.number_of_retries = 60 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.retry_delay = 1 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.send_service_user_token = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.split_loggers = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.timeout = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.verify_ssl = True {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican.verify_ssl_path = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican_service_user.auth_section = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican_service_user.auth_type = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican_service_user.cafile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican_service_user.certfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican_service_user.collect_timing = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican_service_user.insecure = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican_service_user.keyfile = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican_service_user.split_loggers = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] barbican_service_user.timeout = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vault.approle_role_id = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vault.approle_secret_id = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vault.auth_method = approle {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vault.auth_path = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vault.kv_mountpoint = secret {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vault.kv_path = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vault.kv_version = 2 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vault.namespace = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vault.root_token_id = **** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vault.ssl_ca_crt_file = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vault.timeout = 60.0 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vault.token_file = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vault.token_role = None {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vault.use_ssl = False {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:36:35 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] ******************************************************************************** {{(pid=77301) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 24 15:36:35 devstack sudo[77559]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:35 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:35 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:35 devstack sudo[77641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:36:35 devstack sudo[77641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:36 devstack sudo[77641]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:36 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.240s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:36 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:36:36 devstack cinder-volume[77517]: INFO cinder.brick.local_dev.lvm [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 24 15:36:36 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:36 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:36 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:36 devstack sudo[77726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:36:36 devstack sudo[77726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:36 devstack sudo[77726]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:36 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:36 devstack cinder-volume[77517]: DEBUG cinder.brick.local_dev.lvm [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77517) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Jul 24 15:36:36 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:36 devstack sudo[77812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:36:36 devstack sudo[77812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:36 devstack sudo[77812]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:36 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.550s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:36 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:37 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.067s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:37 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:37 devstack sudo[78047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:36:37 devstack sudo[78047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:37 devstack sudo[78047]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:37 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:37 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:37 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:37 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:37 devstack sudo[78051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 24 15:36:37 devstack sudo[78051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:37 devstack sudo[78051]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:37 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.340s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:37 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:37 devstack sudo[78134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:36:37 devstack sudo[78134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:37 devstack sudo[78134]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:37 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:37 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:37 devstack sudo[78137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:36:37 devstack sudo[78137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:38 devstack sudo[78137]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:38 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:38 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:38 devstack sudo[78189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:36:38 devstack sudo[78189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:38 devstack sudo[78189]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:38 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:38 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:38 devstack sudo[78229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:36:38 devstack sudo[78229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:38 devstack sudo[78229]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:38 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:38 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:38 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:38 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:38 devstack sudo[78233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:36:38 devstack sudo[78233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:39 devstack sudo[78233]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:39 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:39 devstack cinder-volume[77517]: INFO cinder.volume.drivers.lvm [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 24 15:36:39 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:39 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:39 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:39 devstack sudo[78237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:36:39 devstack sudo[78237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:39 devstack sudo[78237]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:39 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:39 devstack cinder-volume[77517]: DEBUG cinder.volume.drivers.lvm [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Updating volume stats {{(pid=77517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 15:36:39 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:39 devstack sudo[78247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:36:39 devstack sudo[78247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:39 devstack sudo[78247]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:39 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:39 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:39 devstack sudo[78250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:36:39 devstack sudo[78250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:39 devstack sudo[78250]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:39 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:39 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:39 devstack sudo[78253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:36:39 devstack sudo[78253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:40 devstack sudo[78253]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:40 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:40 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:40 devstack sudo[78256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:36:40 devstack sudo[78256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:40 devstack sudo[78256]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:40 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:40 devstack cinder-volume[77517]: INFO cinder.volume.driver [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Driver hasn't implemented _init_vendor_properties() Jul 24 15:36:40 devstack cinder-volume[77517]: DEBUG cinder.volume.driver [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77517) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 24 15:36:40 devstack cinder-volume[77517]: DEBUG oslo_db.sqlalchemy.engines [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77517) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:36:40 devstack cinder-volume[77517]: DEBUG dbcounter [-] [77517] Writer thread running {{(pid=77517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 15:36:40 devstack cinder-volume[77517]: DEBUG cinder.db.api [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Building query based on filter {{(pid=77517) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 24 15:36:40 devstack cinder-volume[77517]: DEBUG cinder.image.image_utils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77517) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 24 15:36:40 devstack cinder-volume[77517]: INFO cinder.keymgr.migration [None req-323f11d6-0e9d-4baa-b7e4-d386d4c7e0e1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 24 15:36:40 devstack cinder-volume[77517]: DEBUG cinder.volume.drivers.lvm [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Updating volume stats {{(pid=77517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 15:36:40 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:40 devstack sudo[78262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:36:40 devstack sudo[78262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:40 devstack sudo[78262]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:40 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:40 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:40 devstack sudo[78265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:36:40 devstack sudo[78265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:41 devstack sudo[78265]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:41 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:41 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:41 devstack sudo[78268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:36:41 devstack sudo[78268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:41 devstack sudo[78268]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:41 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:41 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:41 devstack sudo[78273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:36:41 devstack sudo[78273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:41 devstack sudo[78273]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:41 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:41 devstack cinder-volume[77517]: DEBUG cinder.manager [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Notifying Schedulers of capabilities ... {{(pid=77517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:36:41 devstack cinder-volume[77517]: INFO cinder.volume.manager [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Driver initialization completed successfully. Jul 24 15:36:41 devstack cinder-volume[77517]: INFO cinder.manager [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Initiating service 2 cleanup Jul 24 15:36:41 devstack cinder-volume[77517]: INFO cinder.manager [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Service 2 cleanup completed. Jul 24 15:36:41 devstack cinder-volume[77517]: DEBUG cinder.service [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Creating RPC server for service cinder-volume {{(pid=77517) start /opt/stack/cinder/cinder/service.py:231}} Jul 24 15:36:41 devstack cinder-volume[77517]: DEBUG cinder.service [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77517) start /opt/stack/cinder/cinder/service.py:237}} Jul 24 15:36:41 devstack cinder-volume[77517]: INFO cinder.volume.manager [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 24 15:36:41 devstack cinder-volume[77517]: DEBUG cinder.volume.drivers.lvm [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Updating volume stats {{(pid=77517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 15:36:41 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:41 devstack sudo[78276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:36:41 devstack sudo[78276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:42 devstack sudo[78276]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:42 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:42 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:42 devstack sudo[78279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:36:42 devstack sudo[78279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:42 devstack sudo[78279]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:42 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:42 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:42 devstack sudo[78282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:36:42 devstack sudo[78282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:42 devstack sudo[78282]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:42 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:42 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:36:42 devstack sudo[78288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:36:42 devstack sudo[78288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:36:42 devstack sudo[78288]: pam_unix(sudo:session): session closed for user root Jul 24 15:36:42 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:36:42 devstack cinder-volume[77517]: INFO cinder.volume.manager [None req-99975f9d-ded0-45c0-a005-b07a1a877645 None None] Driver post RPC initialization completed successfully. Jul 24 15:36:45 devstack cinder-volume[77301]: DEBUG dbcounter [-] [77301] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77301) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:36:52 devstack cinder-volume[77517]: DEBUG dbcounter [-] [77517] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:36:52 devstack cinder-volume[77517]: DEBUG dbcounter [-] [77517] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=77517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:37:09 devstack cinder-volume[77517]: DEBUG oslo_service.periodic_task [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running periodic task VolumeManager._thread_info {{(pid=77517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:37:09 devstack cinder-volume[77517]: DEBUG cinder.volume.manager [None req-19426f58-fa63-4021-8670-64f53288066b None None] thread count: 6 {{(pid=77517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:37:09 devstack cinder-volume[77517]: DEBUG cinder.volume.manager [None req-19426f58-fa63-4021-8670-64f53288066b None None] thread info: [<_MainThread(MainThread, started 132680072233088)>, , , , , ] {{(pid=77517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:38:09 devstack cinder-volume[77517]: DEBUG oslo_service.periodic_task [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:38:09 devstack cinder-volume[77517]: DEBUG cinder.volume.drivers.lvm [None req-19426f58-fa63-4021-8670-64f53288066b None None] Updating volume stats {{(pid=77517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 15:38:09 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:38:09 devstack sudo[80959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:38:09 devstack sudo[80959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:38:10 devstack sudo[80959]: pam_unix(sudo:session): session closed for user root Jul 24 15:38:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:38:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:38:10 devstack sudo[80963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:38:10 devstack sudo[80963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:38:10 devstack sudo[80963]: pam_unix(sudo:session): session closed for user root Jul 24 15:38:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:38:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:38:10 devstack sudo[80966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:38:10 devstack sudo[80966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:38:10 devstack sudo[80966]: pam_unix(sudo:session): session closed for user root Jul 24 15:38:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:38:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:38:10 devstack sudo[80969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:38:10 devstack sudo[80969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:38:11 devstack sudo[80969]: pam_unix(sudo:session): session closed for user root Jul 24 15:38:11 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:38:11 devstack cinder-volume[77517]: DEBUG cinder.manager [None req-19426f58-fa63-4021-8670-64f53288066b None None] Notifying Schedulers of capabilities ... {{(pid=77517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:38:11 devstack cinder-volume[77517]: DEBUG oslo_service.periodic_task [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running periodic task VolumeManager._thread_info {{(pid=77517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:38:11 devstack cinder-volume[77517]: DEBUG cinder.volume.manager [None req-19426f58-fa63-4021-8670-64f53288066b None None] thread count: 6 {{(pid=77517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:38:11 devstack cinder-volume[77517]: DEBUG cinder.volume.manager [None req-19426f58-fa63-4021-8670-64f53288066b None None] thread info: [<_MainThread(MainThread, started 132680072233088)>, , , , , ] {{(pid=77517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:38:52 devstack cinder-volume[77517]: DEBUG dbcounter [-] [77517] Writing DB stats cinder:SELECT=1 {{(pid=77517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:38:52 devstack cinder-volume[77517]: DEBUG dbcounter [-] [77517] Writing DB stats cinder:UPDATE=1 {{(pid=77517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:39:09 devstack cinder-volume[77517]: DEBUG oslo_service.periodic_task [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:39:09 devstack cinder-volume[77517]: DEBUG cinder.volume.drivers.lvm [None req-19426f58-fa63-4021-8670-64f53288066b None None] Updating volume stats {{(pid=77517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 15:39:09 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:39:09 devstack sudo[84616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:39:09 devstack sudo[84616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:39:10 devstack sudo[84616]: pam_unix(sudo:session): session closed for user root Jul 24 15:39:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:39:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:39:10 devstack sudo[84663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:39:10 devstack sudo[84663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:39:10 devstack sudo[84663]: pam_unix(sudo:session): session closed for user root Jul 24 15:39:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:39:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:39:10 devstack sudo[84670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:39:10 devstack sudo[84670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:39:10 devstack sudo[84670]: pam_unix(sudo:session): session closed for user root Jul 24 15:39:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:39:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:39:10 devstack sudo[84683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:39:10 devstack sudo[84683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:39:10 devstack sudo[84683]: pam_unix(sudo:session): session closed for user root Jul 24 15:39:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:39:10 devstack cinder-volume[77517]: DEBUG cinder.manager [None req-19426f58-fa63-4021-8670-64f53288066b None None] Notifying Schedulers of capabilities ... {{(pid=77517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:39:10 devstack cinder-volume[77517]: DEBUG oslo_service.periodic_task [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running periodic task VolumeManager._thread_info {{(pid=77517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:39:10 devstack cinder-volume[77517]: DEBUG cinder.volume.manager [None req-19426f58-fa63-4021-8670-64f53288066b None None] thread count: 6 {{(pid=77517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:39:10 devstack cinder-volume[77517]: DEBUG cinder.volume.manager [None req-19426f58-fa63-4021-8670-64f53288066b None None] thread info: [<_MainThread(MainThread, started 132680072233088)>, , , , , ] {{(pid=77517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:40:09 devstack cinder-volume[77517]: DEBUG oslo_service.periodic_task [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:40:09 devstack cinder-volume[77517]: DEBUG cinder.volume.drivers.lvm [None req-19426f58-fa63-4021-8670-64f53288066b None None] Updating volume stats {{(pid=77517) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Jul 24 15:40:09 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:09 devstack sudo[86310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 24 15:40:09 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:10 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:10 devstack sudo[86315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:40:10 devstack sudo[86315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:10 devstack sudo[86315]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:10 devstack sudo[86318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 24 15:40:10 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:10 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:40:10 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 24 15:40:10 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:40:10 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Jul 24 15:40:10 devstack cinder-volume[77517]: DEBUG oslo_concurrency.processutils [None req-19426f58-fa63-4021-8670-64f53288066b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=77517) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:40:10 devstack cinder-volume[77517]: DEBUG cinder.manager [None req-19426f58-fa63-4021-8670-64f53288066b None None] Notifying Schedulers of capabilities ... {{(pid=77517) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:40:10 devstack cinder-volume[77517]: DEBUG oslo_service.periodic_task [None req-19426f58-fa63-4021-8670-64f53288066b None None] Running periodic task VolumeManager._thread_info {{(pid=77517) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:40:10 devstack cinder-volume[77517]: DEBUG cinder.volume.manager [None req-19426f58-fa63-4021-8670-64f53288066b None None] thread count: 6 {{(pid=77517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:40:10 devstack cinder-volume[77517]: DEBUG cinder.volume.manager [None req-19426f58-fa63-4021-8670-64f53288066b None None] thread info: [<_MainThread(MainThread, started 132680072233088)>, , , , , ] {{(pid=77517) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:40:52 devstack cinder-volume[77517]: DEBUG dbcounter [-] [77517] Writing DB stats cinder:SELECT=1 {{(pid=77517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:40:52 devstack cinder-volume[77517]: DEBUG dbcounter [-] [77517] Writing DB stats cinder:UPDATE=1 {{(pid=77517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:41:03 devstack cinder-volume[77301]: INFO oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Caught SIGTERM, stopping children Jul 24 15:41:03 devstack cinder-volume[77301]: DEBUG oslo_concurrency.lockutils [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Acquiring lock "singleton_lock" {{(pid=77301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 15:41:03 devstack cinder-volume[77301]: DEBUG oslo_concurrency.lockutils [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Acquired lock "singleton_lock" {{(pid=77301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 15:41:03 devstack cinder-volume[77301]: DEBUG oslo_concurrency.lockutils [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Releasing lock "singleton_lock" {{(pid=77301) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 15:41:03 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Stop services. {{(pid=77301) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 24 15:41:03 devstack cinder-volume[77301]: DEBUG oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Killing children. {{(pid=77301) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 24 15:41:03 devstack cinder-volume[77301]: INFO oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Waiting on 1 children to exit Jul 24 15:41:06 devstack cinder-volume[77517]: DEBUG oslo_concurrency.lockutils [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Acquiring lock "singleton_lock" {{(pid=77517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 15:41:06 devstack cinder-volume[77517]: DEBUG oslo_concurrency.lockutils [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Acquired lock "singleton_lock" {{(pid=77517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 15:41:06 devstack cinder-volume[77517]: DEBUG oslo_concurrency.lockutils [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Releasing lock "singleton_lock" {{(pid=77517) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 15:41:06 devstack cinder-volume[77517]: WARNING amqp [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 15:41:06 devstack cinder-volume[77517]: WARNING amqp [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 15:41:06 devstack cinder-volume[77301]: INFO oslo_service.backend._eventlet.service [None req-f66cbf1d-0bde-49cc-9eff-160cd45997f7 None None] Child 77517 exited with status 0 Jul 24 15:41:07 devstack cinder-volume[87538]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 24 15:41:07 devstack cinder-volume[87538]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 15:41:07 devstack cinder-volume[87538]: we strongly recommend against using it for new projects. Jul 24 15:41:07 devstack cinder-volume[87538]: If you are already using Eventlet, we recommend migrating to a different Jul 24 15:41:07 devstack cinder-volume[87538]: framework. For more detail see Jul 24 15:41:07 devstack cinder-volume[87538]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 15:41:07 devstack cinder-volume[87538]: import eventlet # noqa Jul 24 15:41:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87538) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 15:41:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87538) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 15:41:09 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87538) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 15:41:09 devstack cinder-volume[87538]: INFO dbcounter [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Registered counter for database cinder Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_db.sqlalchemy.engines [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87538) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG dbcounter [-] [87538] Writer thread running {{(pid=87538) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 15:41:10 devstack cinder-volume[87538]: INFO cinder.rpc [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 24 15:41:10 devstack cinder-volume[87538]: INFO cinder.rpc [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_db.sqlalchemy.engines [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87538) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:41:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Determined volume DB was empty at startup. Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG cinder.volume.manager [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87538) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 24 15:41:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 24 15:41:10 devstack cinder-volume[87538]: WARNING stevedore.named [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 15:41:10 devstack cinder-volume[87538]: WARNING castellan.key_manager [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 15:41:10 devstack cinder-volume[87538]: WARNING cinder.keymgr.conf_key_mgr [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 15:41:10 devstack cinder-volume[87538]: INFO cinder.volume.manager [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_db.sqlalchemy.engines [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87538) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:41:10 devstack cinder-volume[87538]: INFO oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Starting 1 workers Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Started child 87754 {{(pid=87538) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Full set of CONF: {{(pid=87538) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] ******************************************************************************** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Configuration options gathered from: {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] ================================================================================ {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] allow_availability_zone_fallback = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] allow_compression_on_image_upload = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] allowed_direct_url_schemes = [] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] api_rate_limit = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] auth_strategy = keystone {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_availability_zone = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_host = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_name = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_stats_polling_interval = 60 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backup_api_class = cinder.backup.api.API {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backup_name_template = backup-%s {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backup_use_same_host = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backup_use_temp_snapshot = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] chap_password = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] chap_username = {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cinder_internal_tenant_project_id = 3d377a87b8e74e0cbbe32ac5131ecbe9 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cinder_internal_tenant_user_id = f6bebd750e87471c9cd003bd55fb11ef {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cluster = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] compression_format = gzip {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] compute_api_class = cinder.compute.nova.API {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] config_dir = [] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] config_source = [] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] control_exchange = openstack {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] debug = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] default_availability_zone = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] default_group_type = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] default_volume_type = QuobyteHD {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87754]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] disk_geometry = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] driver_client_cert = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] driver_client_cert_key = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] driver_data_namespace = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] driver_ssl_cert_path = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] driver_ssl_cert_verify = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] driver_use_ssl = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] enable_new_services = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] enable_unsupported_driver = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] enabled_backends = ['QuobyteHD'] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] enforce_multipath_for_image_xfer = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] filter_function = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance_api_insecure = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance_api_servers = ['http://192.168.122.187/image'] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance_api_ssl_compression = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance_ca_certificates_file = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance_catalog_info = image:glance:publicURL {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance_certfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance_keyfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance_num_retries = 3 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance_request_timeout = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] goodness_function = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] graceful_shutdown_timeout = 5 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] group_api_class = cinder.group.api.API {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] host = devstack {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] image_compress_on_upload = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] image_conversion_address_space_limit = 1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] image_conversion_cpu_limit = 60 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] image_conversion_disable = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] image_upload_use_cinder_backend = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] image_upload_use_internal_tenant = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] image_volume_cache_enabled = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] image_volume_cache_max_count = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] image_volume_cache_max_size_gb = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] init_host_max_objects_retrieval = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] instance_format = [instance: %(uuid)s] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] iscsi_target_flags = {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] iscsi_write_cache = on {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] iser_helper = tgtadm {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] iser_ip_address = 192.168.122.187 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] iser_port = 3260 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] log_color = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] log_config_append = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] log_dir = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] log_file = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] log_options = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] log_rotate_interval = 1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] log_rotate_interval_type = days {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] log_rotation_type = none {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] max_age = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] max_logfile_count = 30 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] max_logfile_size_mb = 200 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] max_over_subscription_ratio = 20.0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] message_reap_interval = 86400 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] message_ttl = 2592000 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] migration_create_volume_timeout_secs = 300 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] monkey_patch = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] monkey_patch_modules = [] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] my_ip = 192.168.122.187 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] no_snapshot_gb_quota = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] num_iser_scan_tries = 3 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] num_shell_tries = 3 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] num_volume_device_scan_tries = 3 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] nvmeof_conn_info_version = 1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] nvmet_ns_id = 10 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] nvmet_port_id = 1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] osapi_max_limit = 1000 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87754]: INFO cinder.volume.manager [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Starting volume driver QuobyteDriver (1.2) Jul 24 15:41:10 devstack cinder-volume[87754]: DEBUG cinder.volume.drivers.remotefs [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87754) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] osapi_volume_ext_list = [] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] osapi_volume_listen = 0.0.0.0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] osapi_volume_listen_port = 8776 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] osapi_volume_use_ssl = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] osapi_volume_workers = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] per_volume_size_limit = -1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] periodic_fuzzy_delay = 60 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] periodic_interval = 60 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] project_id_regex = [0-9a-f\-]+ {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] public_endpoint = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] publish_errors = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] quota_backup_gigabytes = 1000 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] quota_backups = 10 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] quota_gigabytes = 1000 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] quota_groups = 10 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] quota_snapshots = 10 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] quota_volumes = 10 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] rate_limit_burst = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] rate_limit_except_level = CRITICAL {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] rate_limit_interval = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] reinit_driver_count = 3 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] replication_device = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] report_discard_supported = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] report_interval = 120 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] reservation_clean_interval = 86400 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] reservation_expire = 86400 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] reserved_image_namespaces = [] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] reserved_percentage = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] rpc_response_timeout = 120 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] run_external_periodic_tasks = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] scst_target_driver = iscsi {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] scst_target_iqn_name = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] service_down_time = 720 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] shell_completion = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] snapshot_name_template = snapshot-%s {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] split_loggers = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] state_path = /opt/stack/data/cinder {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] storage_availability_zone = nova {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] storage_protocol = iSCSI {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] syslog_log_facility = LOG_USER {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] target_helper = lioadm {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] target_ip_address = 192.168.122.187 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] target_port = 3260 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] target_protocol = iscsi {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] target_secondary_ip_addresses = [] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] trace_flags = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] transfer_api_class = cinder.transfer.api.API {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] transport_url = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] until_refresh = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] use_chap_auth = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] use_default_quota_class = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] use_journal = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] use_json = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] use_multipath_for_image_xfer = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] use_stderr = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] use_syslog = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] verify_glance_signatures = enabled {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] volume_api_class = cinder.volume.api.API {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] volume_backend_name = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] volume_clear = zero {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] volume_clear_ionice = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] volume_clear_size = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] volume_copy_bps_limit = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] volume_dd_blocksize = 1M {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] volume_name_template = volume-%s {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] volume_service_inithost_offload = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] volume_usage_audit_period = month {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] zoning_mode = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:10 devstack cinder-volume[87754]: DEBUG cinder.volume.drivers.quobyte [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87754) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 24 15:41:10 devstack cinder-volume[87754]: WARNING cinder.volume.drivers.quobyte [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 24 15:41:10 devstack cinder-volume[87754]: WARNING cinder.volume.drivers.quobyte [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_concurrency.disable_process_locking = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87754]: DEBUG oslo_concurrency.processutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Running cmd (subprocess): mount.quobyte {{(pid=87754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.auth_section = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.auth_type = password {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.auth_version = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.cache = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.certfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.delay_auth_decision = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.http_connect_timeout = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.include_service_catalog = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.insecure = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.interface = public {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.keyfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_password = {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcache_username = {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.region_name = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.service_token_roles_required = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.service_type = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.token_cache_time = 300 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.187/identity {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.backend = dogpile.cache.null {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.backend_argument = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.backend_expiration_time = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.config_prefix = cache.oslo {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.debug_cache_backend = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.enable_retry_client = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.enable_socket_keepalive = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.enabled = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.expiration_time = 600 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.hashclient_retry_attempts = 2 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.memcache_dead_retry = 300 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.memcache_pool_maxsize = 10 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.memcache_sasl_enabled = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.password = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.proxies = [] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.redis_db = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.redis_sentinel_service_name = mymaster {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.redis_server = localhost:6379 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.retry_attempts = 2 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.retry_delay = 0.0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.socket_keepalive_count = 1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.socket_keepalive_idle = 1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.socket_keepalive_interval = 1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.socket_timeout = 1.0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.tls_allowed_ciphers = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.tls_cafile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.tls_certfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.tls_enabled = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.tls_keyfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cache.username = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] coordination.backend_url = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.asyncio_connection = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.asyncio_slave_connection = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.backend = sqlalchemy {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.connection = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.connection_debug = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.connection_parameters = {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.connection_recycle_time = 3600 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.connection_trace = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.db_inc_retry_interval = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.db_max_retries = 20 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.db_max_retry_interval = 10 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.db_retry_interval = 1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.max_overflow = 50 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.max_pool_size = 5 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.max_retries = 10 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.mysql_wsrep_sync_wait = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.pool_timeout = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.retry_interval = 10 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.slave_connection = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.sqlite_synchronous = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.synchronous_reader = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] database.use_db_reconnect = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] profiler.connection_string = messaging:// {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] profiler.enabled = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] profiler.es_doc_type = notification {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] profiler.es_scroll_size = 10000 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] profiler.es_scroll_time = 2m {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] profiler.filter_error_trace = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] profiler.hmac_keys = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] profiler.sentinel_service_name = mymaster {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] profiler.socket_timeout = 0.1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] profiler.trace_requests = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] profiler.trace_sqlalchemy = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] profiler_jaeger.process_tags = {} {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] profiler_jaeger.service_name_prefix = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] profiler_otlp.service_name_prefix = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_policy.enforce_new_defaults = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_policy.policy_default_rule = default {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_policy.policy_file = policy.yaml {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_policy.remote_timeout = 60.0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] privsep_osbrick.group = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] privsep_osbrick.helper_command = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] privsep_osbrick.user = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cinder_sys_admin.group = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cinder_sys_admin.helper_command = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] cinder_sys_admin.user = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] service_user.auth_section = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] service_user.auth_type = password {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] service_user.cafile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] service_user.certfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] service_user.collect_timing = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] service_user.insecure = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] service_user.keyfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] service_user.send_service_user_token = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] service_user.split_loggers = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] service_user.timeout = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance.auth_section = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance.auth_type = password {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance.certfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance.collect_timing = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance.insecure = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance.keyfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance.region_name = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance.split_loggers = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] glance.timeout = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.backend_availability_zone = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.chap_password = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.chap_username = {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.disk_geometry = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.driver_client_cert = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.driver_client_cert_key = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.driver_data_namespace = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.driver_use_ssl = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.enable_unsupported_driver = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.extra_capabilities = {} {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.filter_function = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.goodness_function = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.iscsi_target_flags = {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.iscsi_write_cache = on {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.iser_helper = tgtadm {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.iser_ip_address = 192.168.122.187 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.iser_port = 3260 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.nas_host = {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.nas_login = admin {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.nas_mount_options = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.nas_password = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.nas_private_key = {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.nas_share_path = {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.nas_ssh_port = 22 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.num_shell_tries = 3 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.nvmet_port_id = 1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.quobyte_client_cfg = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.quobyte_volume_url = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.replication_device = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.report_discard_supported = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.reserved_percentage = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.scst_target_driver = iscsi {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.scst_target_iqn_name = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.storage_protocol = iSCSI {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.target_helper = tgtadm {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.target_ip_address = 192.168.122.187 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.target_port = 3260 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.target_protocol = iscsi {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.trace_flags = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.unique_fqdn_network = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.use_chap_auth = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.volume_backend_name = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.volume_clear = zero {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.volume_clear_ionice = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.volume_clear_size = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_reports.file_event_handler = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_reports.log_dir = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.backend_availability_zone = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.backend_host = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.chap_password = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.chap_username = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.chiscsi_conf = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.disk_geometry = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.driver_client_cert = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.driver_client_cert_key = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.driver_data_namespace = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.driver_use_ssl = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.extra_capabilities = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.filter_function = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.goodness_function = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.iscsi_target_flags = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.iscsi_write_cache = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.iser_helper = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.iser_ip_address = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.iser_port = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.iser_target_prefix = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.nas_host = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.nas_login = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.nas_mount_options = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.nas_password = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.nas_private_key = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.nas_share_path = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.nas_ssh_port = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.num_shell_tries = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.nvmet_ns_id = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.nvmet_port_id = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.replication_device = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.report_discard_supported = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.reserved_percentage = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.scst_target_driver = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.storage_protocol = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.target_helper = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87754]: DEBUG oslo_concurrency.processutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] CMD "mount.quobyte" returned: 1 in 0.116s {{(pid=87754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:10 devstack cinder-volume[87754]: DEBUG oslo_concurrency.lockutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:10 devstack cinder-volume[87754]: DEBUG oslo_concurrency.lockutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:10 devstack cinder-volume[87754]: DEBUG cinder.volume.drivers.quobyte [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=87754) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.target_ip_address = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.target_port = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.target_prefix = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.target_protocol = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.trace_flags = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87754]: INFO cinder.volume.drivers.quobyte [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd ... Jul 24 15:41:10 devstack cinder-volume[87754]: DEBUG oslo_concurrency.processutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb -c /etc/quobyte/client-cinder.cfg {{(pid=87754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.unique_fqdn_network = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.use_chap_auth = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.volume_clear = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.volume_clear_ionice = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.volume_clear_size = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] QuobyteHD.volumes_dir = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.ssl = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.ssl_version = {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_notifications.driver = [] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_notifications.retry = -1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] oslo_messaging_notifications.transport_url = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] key_manager.fixed_key = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:10 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.barbican_api_version = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.barbican_endpoint = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.barbican_endpoint_type = public {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.barbican_region_name = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.cafile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.certfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.collect_timing = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.insecure = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.keyfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.number_of_retries = 60 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.retry_delay = 1 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.send_service_user_token = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.split_loggers = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.timeout = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.verify_ssl = True {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican.verify_ssl_path = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican_service_user.auth_section = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican_service_user.auth_type = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican_service_user.cafile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican_service_user.certfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican_service_user.collect_timing = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican_service_user.insecure = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican_service_user.keyfile = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican_service_user.split_loggers = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] barbican_service_user.timeout = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vault.approle_role_id = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vault.approle_secret_id = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vault.auth_method = approle {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vault.auth_path = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vault.kv_mountpoint = secret {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vault.kv_path = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vault.kv_version = 2 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vault.namespace = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vault.root_token_id = **** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vault.ssl_ca_crt_file = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vault.timeout = 60.0 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vault.token_file = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vault.token_role = None {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vault.use_ssl = False {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:11 devstack sudo[87760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb -c /etc/quobyte/client-cinder.cfg Jul 24 15:41:11 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] ******************************************************************************** {{(pid=87538) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 24 15:41:11 devstack sudo[87760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:11 devstack sudo[87760]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG oslo_concurrency.processutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.373s {{(pid=87754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:11 devstack cinder-volume[87754]: INFO cinder.volume.drivers.quobyte [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd succeeded Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG cinder.volume.drivers.quobyte [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=87754) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG oslo_concurrency.lockutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.385s {{(pid=87754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG oslo_concurrency.processutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=87754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:11 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:41:11 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:11 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG oslo_concurrency.processutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.235s {{(pid=87754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:11 devstack cinder-volume[87754]: INFO cinder.volume.driver [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Driver hasn't implemented _init_vendor_properties() Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG cinder.volume.driver [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87754) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG oslo_db.sqlalchemy.engines [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87754) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG dbcounter [-] [87754] Writer thread running {{(pid=87754) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG cinder.db.api [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Building query based on filter {{(pid=87754) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG cinder.image.image_utils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87754) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 24 15:41:11 devstack cinder-volume[87754]: INFO cinder.keymgr.migration [None req-0f161d44-f851-4491-b8db-2a6fdc250f82 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG oslo_concurrency.lockutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG oslo_concurrency.lockutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG cinder.volume.drivers.quobyte [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=87754) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG cinder.volume.drivers.quobyte [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=87754) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG oslo_concurrency.lockutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG oslo_concurrency.processutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=87754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:11 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:41:11 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:11 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG oslo_concurrency.processutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.226s {{(pid=87754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:11 devstack cinder-volume[87754]: DEBUG cinder.manager [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Notifying Schedulers of capabilities ... {{(pid=87754) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:41:11 devstack cinder-volume[87754]: INFO cinder.volume.manager [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Driver initialization completed successfully. Jul 24 15:41:11 devstack cinder-volume[87754]: INFO cinder.manager [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Initiating service 3 cleanup Jul 24 15:41:12 devstack cinder-volume[87754]: INFO cinder.manager [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Service 3 cleanup completed. Jul 24 15:41:12 devstack cinder-volume[87754]: DEBUG cinder.service [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Creating RPC server for service cinder-volume {{(pid=87754) start /opt/stack/cinder/cinder/service.py:231}} Jul 24 15:41:12 devstack cinder-volume[87754]: DEBUG cinder.service [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87754) start /opt/stack/cinder/cinder/service.py:237}} Jul 24 15:41:12 devstack cinder-volume[87754]: INFO cinder.volume.manager [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 24 15:41:12 devstack cinder-volume[87754]: DEBUG oslo_concurrency.lockutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:12 devstack cinder-volume[87754]: DEBUG oslo_concurrency.lockutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:12 devstack cinder-volume[87754]: DEBUG cinder.volume.drivers.quobyte [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=87754) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:41:12 devstack cinder-volume[87754]: DEBUG cinder.volume.drivers.quobyte [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=87754) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:41:12 devstack cinder-volume[87754]: DEBUG oslo_concurrency.lockutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87754) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:12 devstack cinder-volume[87754]: DEBUG oslo_concurrency.processutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=87754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:12 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:41:12 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:12 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:12 devstack cinder-volume[87754]: DEBUG oslo_concurrency.processutils [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.242s {{(pid=87754) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:12 devstack cinder-volume[87754]: INFO cinder.volume.manager [None req-3dade837-aa67-4d3e-b4fb-dce4a1adff92 None None] Driver post RPC initialization completed successfully. Jul 24 15:41:16 devstack cinder-volume[87538]: INFO oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Caught SIGTERM, stopping children Jul 24 15:41:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Acquiring lock "singleton_lock" {{(pid=87538) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 15:41:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Acquired lock "singleton_lock" {{(pid=87538) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 15:41:16 devstack cinder-volume[87538]: DEBUG oslo_concurrency.lockutils [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Releasing lock "singleton_lock" {{(pid=87538) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 15:41:16 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Stop services. {{(pid=87538) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 24 15:41:16 devstack cinder-volume[87538]: DEBUG oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Killing children. {{(pid=87538) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 24 15:41:16 devstack cinder-volume[87538]: INFO oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Waiting on 1 children to exit Jul 24 15:41:20 devstack cinder-volume[87754]: DEBUG oslo_concurrency.lockutils [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Acquiring lock "singleton_lock" {{(pid=87754) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 15:41:20 devstack cinder-volume[87754]: DEBUG oslo_concurrency.lockutils [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Acquired lock "singleton_lock" {{(pid=87754) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 15:41:20 devstack cinder-volume[87754]: DEBUG oslo_concurrency.lockutils [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Releasing lock "singleton_lock" {{(pid=87754) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 15:41:20 devstack cinder-volume[87754]: WARNING amqp [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 15:41:20 devstack cinder-volume[87754]: WARNING amqp [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 24 15:41:20 devstack cinder-volume[87538]: INFO oslo_service.backend._eventlet.service [None req-6bdf9be5-28be-4bb2-8791-324662e7cfdd None None] Child 87754 exited with status 0 Jul 24 15:41:20 devstack cinder-volume[88044]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 24 15:41:20 devstack cinder-volume[88044]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 15:41:20 devstack cinder-volume[88044]: we strongly recommend against using it for new projects. Jul 24 15:41:20 devstack cinder-volume[88044]: If you are already using Eventlet, we recommend migrating to a different Jul 24 15:41:20 devstack cinder-volume[88044]: framework. For more detail see Jul 24 15:41:20 devstack cinder-volume[88044]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 15:41:20 devstack cinder-volume[88044]: import eventlet # noqa Jul 24 15:41:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Jul 24 15:41:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Jul 24 15:41:23 devstack cinder-volume[88044]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88044) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Jul 24 15:41:24 devstack cinder-volume[88044]: INFO dbcounter [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] Registered counter for database cinder Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_db.sqlalchemy.engines [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writer thread running {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 15:41:24 devstack cinder-volume[88044]: INFO cinder.rpc [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 24 15:41:24 devstack cinder-volume[88044]: INFO cinder.rpc [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_db.sqlalchemy.engines [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:41:24 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] Determined volume DB was empty at startup. Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG cinder.volume.manager [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88044) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 24 15:41:24 devstack cinder-volume[88044]: WARNING stevedore.named [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 24 15:41:24 devstack cinder-volume[88044]: WARNING castellan.key_manager [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 15:41:24 devstack cinder-volume[88044]: WARNING cinder.keymgr.conf_key_mgr [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 24 15:41:24 devstack cinder-volume[88044]: INFO cinder.volume.manager [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_db.sqlalchemy.engines [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88044) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:41:24 devstack cinder-volume[88044]: INFO oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] Starting 1 workers Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] Started child 88350 {{(pid=88044) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] Full set of CONF: {{(pid=88044) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] ******************************************************************************** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] Configuration options gathered from: {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] ================================================================================ {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 24 15:41:24 devstack cinder-volume[88350]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] allow_availability_zone_fallback = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] allow_compression_on_image_upload = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] allowed_direct_url_schemes = [] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] api_rate_limit = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] auth_strategy = keystone {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_availability_zone = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_host = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_name = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_stats_polling_interval = 60 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backup_api_class = cinder.backup.api.API {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backup_name_template = backup-%s {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backup_use_same_host = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backup_use_temp_snapshot = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] chap_password = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] chap_username = {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cinder_internal_tenant_project_id = 3d377a87b8e74e0cbbe32ac5131ecbe9 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cinder_internal_tenant_user_id = f6bebd750e87471c9cd003bd55fb11ef {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cluster = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] compression_format = gzip {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] compute_api_class = cinder.compute.nova.API {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] config_dir = [] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] config_source = [] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] control_exchange = openstack {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] debug = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] default_availability_zone = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] default_group_type = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] default_volume_type = QuobyteHD {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] disk_geometry = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] driver_client_cert = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] driver_client_cert_key = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] driver_data_namespace = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] driver_ssl_cert_path = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] driver_ssl_cert_verify = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] driver_use_ssl = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] enable_new_services = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] enable_unsupported_driver = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] enabled_backends = ['QuobyteHD'] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] enforce_multipath_for_image_xfer = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] filter_function = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance_api_insecure = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance_api_servers = ['http://192.168.122.187/image'] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance_api_ssl_compression = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance_ca_certificates_file = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance_catalog_info = image:glance:publicURL {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance_certfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance_keyfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance_num_retries = 3 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance_request_timeout = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] goodness_function = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] graceful_shutdown_timeout = 5 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] group_api_class = cinder.group.api.API {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] host = devstack {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] image_compress_on_upload = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] image_conversion_address_space_limit = 1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] image_conversion_cpu_limit = 60 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] image_conversion_disable = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] image_upload_use_cinder_backend = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] image_upload_use_internal_tenant = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] image_volume_cache_enabled = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] image_volume_cache_max_count = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] image_volume_cache_max_size_gb = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] init_host_max_objects_retrieval = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] instance_format = [instance: %(uuid)s] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] iscsi_target_flags = {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] iscsi_write_cache = on {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] iser_helper = tgtadm {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] iser_ip_address = 192.168.122.187 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] iser_port = 3260 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] log_color = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] log_config_append = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] log_dir = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] log_file = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] log_options = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] log_rotate_interval = 1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] log_rotate_interval_type = days {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] log_rotation_type = none {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] max_age = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] max_logfile_count = 30 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] max_logfile_size_mb = 200 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] max_over_subscription_ratio = 20.0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] message_reap_interval = 86400 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] message_ttl = 2592000 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] migration_create_volume_timeout_secs = 300 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] monkey_patch = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] monkey_patch_modules = [] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] my_ip = 192.168.122.187 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] no_snapshot_gb_quota = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] num_iser_scan_tries = 3 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] num_shell_tries = 3 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] num_volume_device_scan_tries = 3 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] nvmeof_conn_info_version = 1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] nvmet_ns_id = 10 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] nvmet_port_id = 1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] osapi_max_limit = 1000 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] osapi_volume_ext_list = [] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] osapi_volume_listen_port = 8776 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] osapi_volume_use_ssl = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] osapi_volume_workers = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] per_volume_size_limit = -1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] periodic_fuzzy_delay = 60 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] periodic_interval = 60 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] public_endpoint = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] publish_errors = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] quota_backup_gigabytes = 1000 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] quota_backups = 10 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Starting volume driver QuobyteDriver (1.2) Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] quota_gigabytes = 1000 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88350) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] quota_groups = 10 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] quota_snapshots = 10 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] quota_volumes = 10 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] rate_limit_burst = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] rate_limit_except_level = CRITICAL {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] rate_limit_interval = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] reinit_driver_count = 3 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] replication_device = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] report_discard_supported = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] report_interval = 120 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] reservation_clean_interval = 86400 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] reservation_expire = 86400 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] reserved_image_namespaces = [] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] reserved_percentage = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] rpc_response_timeout = 120 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] run_external_periodic_tasks = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] scst_target_driver = iscsi {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] scst_target_iqn_name = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] service_down_time = 720 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] shell_completion = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] snapshot_name_template = snapshot-%s {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] split_loggers = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] state_path = /opt/stack/data/cinder {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] storage_availability_zone = nova {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] storage_protocol = iSCSI {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] syslog_log_facility = LOG_USER {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] target_helper = lioadm {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] target_ip_address = 192.168.122.187 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] target_port = 3260 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] target_protocol = iscsi {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] target_secondary_ip_addresses = [] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] trace_flags = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] transport_url = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] until_refresh = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] use_chap_auth = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] use_default_quota_class = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] use_journal = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] use_json = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] use_multipath_for_image_xfer = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] use_stderr = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] use_syslog = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] verify_glance_signatures = enabled {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] volume_api_class = cinder.volume.api.API {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] volume_backend_name = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] volume_clear = zero {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] volume_clear_ionice = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] volume_clear_size = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] volume_copy_bps_limit = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] volume_dd_blocksize = 1M {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] volume_name_template = volume-%s {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] volume_service_inithost_offload = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] volume_usage_audit_period = month {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] zoning_mode = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_concurrency.disable_process_locking = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.auth_section = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.auth_type = password {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.auth_version = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.cache = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.certfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.include_service_catalog = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.insecure = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.interface = public {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.keyfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_password = {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcache_username = {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.region_name = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.service_type = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.187/identity {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.backend = dogpile.cache.null {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.backend_argument = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.backend_expiration_time = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.config_prefix = cache.oslo {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.debug_cache_backend = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.enable_retry_client = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.enable_socket_keepalive = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.enabled = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.expiration_time = 600 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.hashclient_retry_attempts = 2 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.memcache_dead_retry = 300 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.memcache_pool_maxsize = 10 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.memcache_sasl_enabled = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.password = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.proxies = [] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.redis_db = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.redis_server = localhost:6379 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.retry_attempts = 2 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.retry_delay = 0.0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.socket_keepalive_count = 1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.socket_keepalive_idle = 1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.socket_keepalive_interval = 1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.socket_timeout = 1.0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.tls_allowed_ciphers = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.tls_cafile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.tls_certfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.tls_enabled = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.tls_keyfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cache.username = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] coordination.backend_url = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.asyncio_connection = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.asyncio_slave_connection = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.backend = sqlalchemy {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.connection = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.connection_debug = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.connection_parameters = {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.connection_recycle_time = 3600 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.connection_trace = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.db_inc_retry_interval = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.db_max_retries = 20 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.db_max_retry_interval = 10 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.db_retry_interval = 1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.max_overflow = 50 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.max_pool_size = 5 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.max_retries = 10 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.mysql_wsrep_sync_wait = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.pool_timeout = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.retry_interval = 10 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.slave_connection = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.sqlite_synchronous = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.synchronous_reader = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] database.use_db_reconnect = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] profiler.connection_string = messaging:// {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] profiler.enabled = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] profiler.es_doc_type = notification {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] profiler.es_scroll_size = 10000 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] profiler.es_scroll_time = 2m {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] profiler.filter_error_trace = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] profiler.hmac_keys = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] profiler.sentinel_service_name = mymaster {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] profiler.socket_timeout = 0.1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] profiler.trace_requests = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] profiler.trace_sqlalchemy = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] profiler_jaeger.process_tags = {} {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] profiler_jaeger.service_name_prefix = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] profiler_otlp.service_name_prefix = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_policy.enforce_new_defaults = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_policy.policy_default_rule = default {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_policy.policy_file = policy.yaml {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88350) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] privsep_osbrick.group = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.quobyte [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] privsep_osbrick.helper_command = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.quobyte [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] privsep_osbrick.user = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cinder_sys_admin.group = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cinder_sys_admin.helper_command = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Running cmd (subprocess): mount.quobyte {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] cinder_sys_admin.user = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] service_user.auth_section = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] service_user.auth_type = password {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] service_user.cafile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] service_user.certfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] service_user.collect_timing = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] service_user.insecure = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] service_user.keyfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] service_user.send_service_user_token = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] service_user.split_loggers = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] service_user.timeout = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance.auth_section = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance.auth_type = password {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance.certfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance.collect_timing = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance.insecure = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance.keyfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance.region_name = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance.split_loggers = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] glance.timeout = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.backend_availability_zone = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.chap_password = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.chap_username = {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.disk_geometry = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.driver_client_cert = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.driver_client_cert_key = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.driver_data_namespace = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.driver_use_ssl = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.extra_capabilities = {} {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.filter_function = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.goodness_function = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.iscsi_target_flags = {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.iscsi_write_cache = on {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.iser_helper = tgtadm {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.iser_ip_address = 192.168.122.187 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.iser_port = 3260 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.nas_host = {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.nas_login = admin {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.nas_mount_options = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.nas_password = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.nas_private_key = {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.nas_share_path = {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.num_shell_tries = 3 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.quobyte_volume_url = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.replication_device = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.report_discard_supported = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.reserved_percentage = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.target_helper = tgtadm {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.target_ip_address = 192.168.122.187 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.target_port = 3260 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.target_protocol = iscsi {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.trace_flags = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.unique_fqdn_network = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.use_chap_auth = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.volume_backend_name = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.volume_clear = zero {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.volume_clear_ionice = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.volume_clear_size = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_reports.file_event_handler = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_reports.log_dir = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.backend_availability_zone = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.backend_host = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.chap_password = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.chap_username = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.chiscsi_conf = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.disk_geometry = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.driver_client_cert = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.driver_data_namespace = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.driver_use_ssl = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.extra_capabilities = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.filter_function = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.goodness_function = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.iser_helper = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.iser_ip_address = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.iser_port = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.iser_target_prefix = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.nas_host = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.nas_login = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.nas_mount_options = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.nas_password = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.nas_private_key = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.nas_share_path = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.nas_ssh_port = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.num_shell_tries = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.nvmet_port_id = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.replication_device = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.report_discard_supported = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.reserved_percentage = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.scst_target_driver = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.storage_protocol = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.target_helper = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.target_ip_address = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.target_port = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.target_prefix = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.target_protocol = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.trace_flags = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.use_chap_auth = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.volume_clear = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.volume_clear_size = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack quobyte-client[88351]: Reading configuration file: /etc/quobyte/client.cfg Jul 24 15:41:24 devstack quobyte-client[88351]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] QuobyteHD.volumes_dir = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.ssl = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_notifications.driver = [] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_notifications.retry = -1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] key_manager.fixed_key = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.barbican_api_version = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.barbican_endpoint = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.barbican_endpoint_type = public {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.barbican_region_name = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.cafile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.certfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.collect_timing = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.insecure = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.keyfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.number_of_retries = 60 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.retry_delay = 1 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.send_service_user_token = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.split_loggers = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.timeout = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.verify_ssl = True {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican.verify_ssl_path = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican_service_user.auth_section = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican_service_user.auth_type = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican_service_user.cafile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican_service_user.certfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican_service_user.collect_timing = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican_service_user.insecure = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican_service_user.keyfile = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican_service_user.split_loggers = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] barbican_service_user.timeout = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vault.approle_role_id = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vault.approle_secret_id = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vault.auth_method = approle {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vault.auth_path = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vault.kv_mountpoint = secret {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vault.kv_path = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vault.kv_version = 2 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vault.namespace = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vault.root_token_id = **** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vault.ssl_ca_crt_file = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vault.timeout = 60.0 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vault.token_file = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vault.token_role = None {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vault.use_ssl = False {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 24 15:41:24 devstack cinder-volume[88044]: DEBUG oslo_service.backend._eventlet.service [None req-bdfeef8e-c709-4147-86dd-3e56b2d20070 None None] ******************************************************************************** {{(pid=88044) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 24 15:41:24 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:41:24 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:25 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.242s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:25 devstack cinder-volume[88350]: INFO cinder.volume.driver [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Driver hasn't implemented _init_vendor_properties() Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG cinder.volume.driver [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88350) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG oslo_db.sqlalchemy.engines [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88350) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writer thread running {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG cinder.db.api [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Building query based on filter {{(pid=88350) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88350) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:25 devstack cinder-volume[88350]: INFO cinder.keymgr.migration [None req-2bacffce-2260-4bd4-ac01-abb7e3dc18f4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 24 15:41:25 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:41:25 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:25 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.235s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:41:25 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Driver initialization completed successfully. Jul 24 15:41:25 devstack cinder-volume[88350]: INFO cinder.manager [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Initiating service 3 cleanup Jul 24 15:41:25 devstack cinder-volume[88350]: INFO cinder.manager [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Service 3 cleanup completed. Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG cinder.service [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Creating RPC server for service cinder-volume {{(pid=88350) start /opt/stack/cinder/cinder/service.py:231}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG cinder.service [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88350) start /opt/stack/cinder/cinder/service.py:237}} Jul 24 15:41:25 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:41:25 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:41:25 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:41:25 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Jul 24 15:41:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.238s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:41:25 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-24c6d386-a5bf-41c0-b025-df085ed7db00 None None] Driver post RPC initialization completed successfully. Jul 24 15:41:34 devstack cinder-volume[88044]: DEBUG dbcounter [-] [88044] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88044) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:41:35 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=2 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:41:35 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:41:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:41:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 6 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:41:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:42:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:42:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:42:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:42:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:40 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:42:40 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Flow 'volume_create_manager' (af1b5e05-03bc-4478-b605-e9bf6d285622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225a746d-3c79-4089-943f-1e6cfc9e8626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225a746d-3c79-4089-943f-1e6cfc9e8626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-869825640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae9239e-80d9-428b-8cd6-0f6adad2214c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff43ff36b7b4a7f87eccaac19bcb5cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:42:40Z,use_quota=True,user_id='6964aed6b1be42fead6cff9b864c3d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e099a188-91c5-4e3a-8862-f1194fc020ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:40 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e099a188-91c5-4e3a-8862-f1194fc020ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba51a52-c553-4fe8-90a9-e198f3483fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba51a52-c553-4fe8-90a9-e198f3483fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eae9239e-80d9-428b-8cd6-0f6adad2214c', 'volume_name': 'volume-eae9239e-80d9-428b-8cd6-0f6adad2214c', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a161eda-ac27-49bf-9ee2-25ac28c4bd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a161eda-ac27-49bf-9ee2-25ac28c4bd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2d2072-cb0c-43df-ad09-4a58bcbc89d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:40 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Volume eae9239e-80d9-428b-8cd6-0f6adad2214c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eae9239e-80d9-428b-8cd6-0f6adad2214c', 'volume_size': 1} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:42:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-869825640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eae9239e-80d9-428b-8cd6-0f6adad2214c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eff43ff36b7b4a7f87eccaac19bcb5cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:42:40Z,use_quota=True,user_id='6964aed6b1be42fead6cff9b864c3d92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Creating volume eae9239e-80d9-428b-8cd6-0f6adad2214c {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:42:40 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eae9239e-80d9-428b-8cd6-0f6adad2214c 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.870s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 6 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:42:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:42:40 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eae9239e-80d9-428b-8cd6-0f6adad2214c 1073741824 Jul 24 15:42:40 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:42 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eae9239e-80d9-428b-8cd6-0f6adad2214c 1073741824" returned: 0 in 1.255s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eae9239e-80d9-428b-8cd6-0f6adad2214c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:42 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eae9239e-80d9-428b-8cd6-0f6adad2214c Jul 24 15:42:42 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:42 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eae9239e-80d9-428b-8cd6-0f6adad2214c" returned: 0 in 0.609s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:42:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2d2072-cb0c-43df-ad09-4a58bcbc89d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eae9239e-80d9-428b-8cd6-0f6adad2214c', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00d1dd7-2793-4a0b-a2cb-a5b0290fd76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:42 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Volume volume-eae9239e-80d9-428b-8cd6-0f6adad2214c (eae9239e-80d9-428b-8cd6-0f6adad2214c): created successfully Jul 24 15:42:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e00d1dd7-2793-4a0b-a2cb-a5b0290fd76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Flow 'volume_create_manager' (af1b5e05-03bc-4478-b605-e9bf6d285622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:42:42 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-5c399e95-ba7f-4229-9c4f-5043d5db22bc tempest-DeleteServersTestJSON-681324372 None] Created volume successfully. Jul 24 15:42:49 devstack cinder-volume[88350]: WARNING py.warnings [req-138e10bb-12b0-4051-b267-87bd9d1d1098 req-38fd2e6f-e4b0-4e37-9f1b-f66d58a17c5b tempest-DeleteServersTestJSON-681324372 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 24 15:42:49 devstack cinder-volume[88350]: .first() Jul 24 15:42:49 devstack cinder-volume[88350]: Jul 24 15:42:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-138e10bb-12b0-4051-b267-87bd9d1d1098 req-38fd2e6f-e4b0-4e37-9f1b-f66d58a17c5b tempest-DeleteServersTestJSON-681324372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-138e10bb-12b0-4051-b267-87bd9d1d1098 req-38fd2e6f-e4b0-4e37-9f1b-f66d58a17c5b tempest-DeleteServersTestJSON-681324372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-138e10bb-12b0-4051-b267-87bd9d1d1098 req-38fd2e6f-e4b0-4e37-9f1b-f66d58a17c5b tempest-DeleteServersTestJSON-681324372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-138e10bb-12b0-4051-b267-87bd9d1d1098 req-38fd2e6f-e4b0-4e37-9f1b-f66d58a17c5b tempest-DeleteServersTestJSON-681324372 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-eae9239e-80d9-428b-8cd6-0f6adad2214c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f35ef35b-89cc-4c7b-be9f-a69bdbd7de67', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:42:50 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-138e10bb-12b0-4051-b267-87bd9d1d1098 req-38fd2e6f-e4b0-4e37-9f1b-f66d58a17c5b tempest-DeleteServersTestJSON-681324372 None] attachment_update completed successfully. Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Flow 'volume_create_manager' (19a8cbdf-211f-4a39-a8ff-e83a08856f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa30018b-4750-4262-bd08-2d56f6158d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa30018b-4750-4262-bd08-2d56f6158d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-545345656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6d191b-296b-488c-9706-a69f7eeeb786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c462a7aa42594daabae8e19715153428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:42:53Z,use_quota=True,user_id='85e01b45dd454e63b6bc03154547057d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f163d3-1e1e-4f2c-89e6-fa784152eee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f163d3-1e1e-4f2c-89e6-fa784152eee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9497f1d3-266f-4f06-9d76-fa8644a7436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9497f1d3-266f-4f06-9d76-fa8644a7436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf6d191b-296b-488c-9706-a69f7eeeb786', 'volume_name': 'volume-cf6d191b-296b-488c-9706-a69f7eeeb786', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b80517-9108-450c-ad54-48c023f68935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b80517-9108-450c-ad54-48c023f68935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39dcf8de-a693-4729-8d6c-e3927d7ef126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:53 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Volume cf6d191b-296b-488c-9706-a69f7eeeb786: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf6d191b-296b-488c-9706-a69f7eeeb786', 'volume_size': 1} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-545345656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6d191b-296b-488c-9706-a69f7eeeb786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c462a7aa42594daabae8e19715153428',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:42:53Z,use_quota=True,user_id='85e01b45dd454e63b6bc03154547057d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Creating volume cf6d191b-296b-488c-9706-a69f7eeeb786 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:42:53 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:42:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf6d191b-296b-488c-9706-a69f7eeeb786 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:53 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf6d191b-296b-488c-9706-a69f7eeeb786 1073741824 Jul 24 15:42:53 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:54 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf6d191b-296b-488c-9706-a69f7eeeb786 1073741824" returned: 0 in 1.131s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf6d191b-296b-488c-9706-a69f7eeeb786 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:54 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf6d191b-296b-488c-9706-a69f7eeeb786 Jul 24 15:42:54 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:54 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf6d191b-296b-488c-9706-a69f7eeeb786" returned: 0 in 0.428s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:42:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:42:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39dcf8de-a693-4729-8d6c-e3927d7ef126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf6d191b-296b-488c-9706-a69f7eeeb786', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd09b673-5896-49e6-917a-a257a87a812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:42:54 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Volume volume-cf6d191b-296b-488c-9706-a69f7eeeb786 (cf6d191b-296b-488c-9706-a69f7eeeb786): created successfully Jul 24 15:42:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd09b673-5896-49e6-917a-a257a87a812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:42:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Flow 'volume_create_manager' (19a8cbdf-211f-4a39-a8ff-e83a08856f25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:42:55 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-bc9ef00c-3527-420c-8509-149d13afb4eb tempest-VolumesAdminNegativeTest-1496509538 None] Created volume successfully. Jul 24 15:42:55 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-55c5d7d5-5450-4483-8346-5cb1080b4b66 req-04961bbd-4e55-462b-8637-aa136d4f82ba tempest-DeleteServersTestJSON-681324372 None] Terminate volume connection completed successfully. Jul 24 15:42:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-55c5d7d5-5450-4483-8346-5cb1080b4b66 req-04961bbd-4e55-462b-8637-aa136d4f82ba tempest-DeleteServersTestJSON-681324372 None] Deleting attachment f35ef35b-89cc-4c7b-be9f-a69bdbd7de67. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:42:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Acquiring lock "cinder-cf6d191b-296b-488c-9706-a69f7eeeb786-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Lock "cinder-cf6d191b-296b-488c-9706-a69f7eeeb786-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Acquiring lock "cinder-quobyte-cf6d191b-296b-488c-9706-a69f7eeeb786" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Lock "cinder-quobyte-cf6d191b-296b-488c-9706-a69f7eeeb786" acquired by "delete_volume" :: waited 0.041s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:56 devstack cinder-volume[88350]: INFO oslo.privsep.daemon [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp45gqsh85/privsep.sock'] Jul 24 15:42:56 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp45gqsh85/privsep.sock Jul 24 15:42:56 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:57 devstack cinder-volume[88350]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Jul 24 15:42:57 devstack cinder-volume[88350]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 24 15:42:57 devstack cinder-volume[88350]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 24 15:42:57 devstack cinder-volume[88350]: WARNING oslo.privsep.daemon [-] privsep log: Jul 24 15:42:57 devstack cinder-volume[88350]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 24 15:42:57 devstack cinder-volume[88350]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 24 15:42:57 devstack cinder-volume[88350]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 24 15:42:57 devstack cinder-volume[88350]: WARNING oslo.privsep.daemon [-] privsep log: Jul 24 15:42:57 devstack cinder-volume[88350]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Jul 24 15:42:58 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:58 devstack cinder-volume[88350]: INFO oslo.privsep.daemon [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Spawned new privsep daemon via rootwrap Jul 24 15:42:58 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Accepted privsep connection to /tmp/tmp45gqsh85/privsep.sock {{(pid=88350) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 24 15:42:58 devstack cinder-volume[88350]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 24 15:42:58 devstack cinder-volume[88350]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 24 15:42:58 devstack cinder-volume[88350]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 24 15:42:58 devstack cinder-volume[88350]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90050 Jul 24 15:42:58 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[98de95dc-46f5-4cc9-99a7-ab5af755077c]: (2,) {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:58 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e696b347-826d-43e6-a12a-4eb59ba651d4]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf6d191b-296b-488c-9706-a69f7eeeb786 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Acquiring lock "cinder-eae9239e-80d9-428b-8cd6-0f6adad2214c-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Lock "cinder-eae9239e-80d9-428b-8cd6-0f6adad2214c-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Acquiring lock "cinder-quobyte-eae9239e-80d9-428b-8cd6-0f6adad2214c" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:42:58 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf6d191b-296b-488c-9706-a69f7eeeb786 Jul 24 15:42:58 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Lock "cinder-quobyte-eae9239e-80d9-428b-8cd6-0f6adad2214c" acquired by "delete_volume" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:42:58 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fbaed2-779c-4fef-ad69-f141d805a9d6]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:42:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eae9239e-80d9-428b-8cd6-0f6adad2214c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:58 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eae9239e-80d9-428b-8cd6-0f6adad2214c Jul 24 15:42:58 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:59 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf6d191b-296b-488c-9706-a69f7eeeb786" returned: 0 in 0.680s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf6d191b-296b-488c-9706-a69f7eeeb786 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:59 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf6d191b-296b-488c-9706-a69f7eeeb786 Jul 24 15:42:59 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:59 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eae9239e-80d9-428b-8cd6-0f6adad2214c" returned: 0 in 0.580s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eae9239e-80d9-428b-8cd6-0f6adad2214c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:42:59 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eae9239e-80d9-428b-8cd6-0f6adad2214c Jul 24 15:42:59 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:42:59 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf6d191b-296b-488c-9706-a69f7eeeb786" returned: 0 in 0.440s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Lock "cinder-quobyte-cf6d191b-296b-488c-9706-a69f7eeeb786" released by "delete_volume" :: held 3.071s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:59 devstack cinder-volume[88350]: WARNING cinder.quota [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:42:59 devstack cinder-volume[88350]: WARNING cinder.quota [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:42:59 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Jul 24 15:42:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eae9239e-80d9-428b-8cd6-0f6adad2214c" returned: 0 in 0.436s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:42:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Lock "cinder-quobyte-eae9239e-80d9-428b-8cd6-0f6adad2214c" released by "delete_volume" :: held 1.108s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:42:59 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Created reservations ['5873bd09-bc1e-43d8-a820-ba99debb7f1b', '185747fc-9946-4758-a881-2c57ae03030b', '3bfd0c44-5280-4baa-b73c-be11ce768974', '14cea0ab-ef2d-4948-b1ca-8e185eefcaac'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:42:59 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Created reservations ['eb239ae4-b3e2-4137-89f2-4ad474833c17', '098123a3-fac4-4b00-b40e-50eb46910fb2', '2fd3412f-9866-4d28-acca-284b36c38dd0', '06fd17da-e294-4f1a-92d2-6cffcc92f445'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:00 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:43:00 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:00 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:43:00 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:00 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.455s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:43:00 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Deleted volume successfully. Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-01a3c36e-6534-4690-a8f9-b016814d6902 tempest-VolumesAdminNegativeTest-1496509538 None] Lock "cinder-cf6d191b-296b-488c-9706-a69f7eeeb786-delete_volume" released by "delete_volume" :: held 4.223s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:43:00 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.398s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:43:00 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Deleted volume successfully. Jul 24 15:43:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03a2bae5-a9ad-45ba-8a72-d7bc71cccc79 tempest-DeleteServersTestJSON-681324372 None] Lock "cinder-eae9239e-80d9-428b-8cd6-0f6adad2214c-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Flow 'volume_create_manager' (fbb6e53c-6d8d-486f-a698-26f8eea8fdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121bc283-d1a0-4092-9aeb-683ebe85de86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (121bc283-d1a0-4092-9aeb-683ebe85de86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-126717187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311abd92-7a1d-4572-94d6-26a31d4713b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44045bea48e2425bb73fb9ac8fb7ac36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:43:03Z,use_quota=True,user_id='1275cbbf7d314d29909c1ba1657da49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca9e556-b13c-4bf5-99da-2d7a5b20ee68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca9e556-b13c-4bf5-99da-2d7a5b20ee68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014dfb26-404b-46d8-9fe2-9319c2cb0ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014dfb26-404b-46d8-9fe2-9319c2cb0ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '311abd92-7a1d-4572-94d6-26a31d4713b9', 'volume_name': 'volume-311abd92-7a1d-4572-94d6-26a31d4713b9', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01f65e4-aeda-4952-aa18-d3262ce9001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01f65e4-aeda-4952-aa18-d3262ce9001e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfbbf6a-61f6-4565-8839-688e031f81c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:03 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Volume 311abd92-7a1d-4572-94d6-26a31d4713b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-311abd92-7a1d-4572-94d6-26a31d4713b9', 'volume_size': 1} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-126717187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311abd92-7a1d-4572-94d6-26a31d4713b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44045bea48e2425bb73fb9ac8fb7ac36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:43:03Z,use_quota=True,user_id='1275cbbf7d314d29909c1ba1657da49c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Creating volume 311abd92-7a1d-4572-94d6-26a31d4713b9 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:43:03 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-311abd92-7a1d-4572-94d6-26a31d4713b9 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:03 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-311abd92-7a1d-4572-94d6-26a31d4713b9 1073741824 Jul 24 15:43:03 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:03 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-311abd92-7a1d-4572-94d6-26a31d4713b9 1073741824" returned: 0 in 0.571s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-311abd92-7a1d-4572-94d6-26a31d4713b9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:03 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-311abd92-7a1d-4572-94d6-26a31d4713b9 Jul 24 15:43:03 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:04 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-311abd92-7a1d-4572-94d6-26a31d4713b9" returned: 0 in 0.351s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:43:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfbbf6a-61f6-4565-8839-688e031f81c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311abd92-7a1d-4572-94d6-26a31d4713b9', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62117730-e0c8-4308-b92e-5686248138e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:04 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Volume volume-311abd92-7a1d-4572-94d6-26a31d4713b9 (311abd92-7a1d-4572-94d6-26a31d4713b9): created successfully Jul 24 15:43:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62117730-e0c8-4308-b92e-5686248138e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Flow 'volume_create_manager' (fbb6e53c-6d8d-486f-a698-26f8eea8fdd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:43:04 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-0e0338b3-6bdb-404a-bc66-27fc7a772fcc tempest-AttachVolumeShelveTestJSON-180900870 None] Created volume successfully. Jul 24 15:43:14 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=26,cinder:SELECT=21,cinder:INSERT=7,cinder:DELETE=1 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:43:14 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=26,cinder:UPDATE=27,cinder:DELETE=4,cinder:INSERT=4 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:43:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-cda5db20-47b0-472e-ae3f-fc55ff498526 req-87d799e0-8bbb-4944-99f0-3e4b4a49bd12 tempest-AttachVolumeShelveTestJSON-180900870 None] No connector for attachment 3f5409ea-6568-4085-a184-22132bbc3ad3; skipping storage backend terminate_connection call. {{(pid=88350) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 24 15:43:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-cda5db20-47b0-472e-ae3f-fc55ff498526 req-87d799e0-8bbb-4944-99f0-3e4b4a49bd12 tempest-AttachVolumeShelveTestJSON-180900870 None] Deleting attachment 3f5409ea-6568-4085-a184-22132bbc3ad3. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:43:35 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=1 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:43:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:43:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:43:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:43:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:40 devstack sudo[90311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:43:40 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=1,cinder:SELECT=2 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Flow 'volume_create_manager' (de53c75e-421a-4af3-9783-44636ee7d75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8789fd3-9366-493e-9847-e4d4a70ecb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8789fd3-9366-493e-9847-e4d4a70ecb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-992789007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c548be01-a5e5-44ca-9033-235f561e3f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2bea27ce534665a388924ba847c20f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:43:40Z,use_quota=True,user_id='d7259878a18d4088b5eb4cf8c08c2dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:40 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bffecee-6314-4549-886b-44eb7c21a875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bffecee-6314-4549-886b-44eb7c21a875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5095050-8b0e-4a11-83eb-fd9e80d519df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5095050-8b0e-4a11-83eb-fd9e80d519df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c548be01-a5e5-44ca-9033-235f561e3f30', 'volume_name': 'volume-c548be01-a5e5-44ca-9033-235f561e3f30', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78fca362-5692-48ab-98d5-894fd7e7d075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78fca362-5692-48ab-98d5-894fd7e7d075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42214883-e3f3-46be-8648-a51962c77de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:40 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Volume c548be01-a5e5-44ca-9033-235f561e3f30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c548be01-a5e5-44ca-9033-235f561e3f30', 'volume_size': 1} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-992789007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c548be01-a5e5-44ca-9033-235f561e3f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b2bea27ce534665a388924ba847c20f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:43:40Z,use_quota=True,user_id='d7259878a18d4088b5eb4cf8c08c2dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Creating volume c548be01-a5e5-44ca-9033-235f561e3f30 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:43:40 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c548be01-a5e5-44ca-9033-235f561e3f30 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.721s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:43:40 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c548be01-a5e5-44ca-9033-235f561e3f30 1073741824 Jul 24 15:43:40 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:41 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c548be01-a5e5-44ca-9033-235f561e3f30 1073741824" returned: 0 in 0.705s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c548be01-a5e5-44ca-9033-235f561e3f30 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:43:41 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c548be01-a5e5-44ca-9033-235f561e3f30 Jul 24 15:43:41 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:43:42 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Jul 24 15:43:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c548be01-a5e5-44ca-9033-235f561e3f30" returned: 0 in 0.581s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:43:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:43:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:43:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42214883-e3f3-46be-8648-a51962c77de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c548be01-a5e5-44ca-9033-235f561e3f30', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b076d86-ffb1-489d-8095-0d336e7777a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:43:42 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Volume volume-c548be01-a5e5-44ca-9033-235f561e3f30 (c548be01-a5e5-44ca-9033-235f561e3f30): created successfully Jul 24 15:43:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b076d86-ffb1-489d-8095-0d336e7777a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:43:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Flow 'volume_create_manager' (de53c75e-421a-4af3-9783-44636ee7d75f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:43:42 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a5071f0a-4c18-49dd-9af8-d7446b42768f tempest-TaggedAttachmentsTest-1944421502 None] Created volume successfully. Jul 24 15:43:52 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:43:52 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Flow 'volume_create_manager' (b864a4ba-2c37-4a5f-bad5-2d04ba0966c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23e35db-a4d2-44df-8837-0f5940313f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23e35db-a4d2-44df-8837-0f5940313f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1750339971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfe97779-863c-431c-9bec-824bb78b1159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec444ba50cf6411b9278af067383c680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:07Z,use_quota=True,user_id='7d3da0bb91fe47d8bb7730f933cd25dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052e3b72-167f-4197-9fb8-ebfd4722d25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052e3b72-167f-4197-9fb8-ebfd4722d25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d00a119-e832-4364-bdd5-776e44596815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d00a119-e832-4364-bdd5-776e44596815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfe97779-863c-431c-9bec-824bb78b1159', 'volume_name': 'volume-bfe97779-863c-431c-9bec-824bb78b1159', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4d7c76-c4d5-4625-8c99-70a6e42eed84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4d7c76-c4d5-4625-8c99-70a6e42eed84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17eb7164-c65d-4ac6-961f-f6d5f585b81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:07 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Volume bfe97779-863c-431c-9bec-824bb78b1159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfe97779-863c-431c-9bec-824bb78b1159', 'volume_size': 1} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1750339971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfe97779-863c-431c-9bec-824bb78b1159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec444ba50cf6411b9278af067383c680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:07Z,use_quota=True,user_id='7d3da0bb91fe47d8bb7730f933cd25dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Creating volume bfe97779-863c-431c-9bec-824bb78b1159 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:44:07 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:44:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bfe97779-863c-431c-9bec-824bb78b1159 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:07 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bfe97779-863c-431c-9bec-824bb78b1159 1073741824 Jul 24 15:44:07 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:08 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bfe97779-863c-431c-9bec-824bb78b1159 1073741824" returned: 0 in 1.029s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bfe97779-863c-431c-9bec-824bb78b1159 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:08 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bfe97779-863c-431c-9bec-824bb78b1159 Jul 24 15:44:08 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:08 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bfe97779-863c-431c-9bec-824bb78b1159" returned: 0 in 0.396s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:44:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17eb7164-c65d-4ac6-961f-f6d5f585b81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfe97779-863c-431c-9bec-824bb78b1159', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a884124-cb0e-4a4e-b007-563ecd8712a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:09 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Volume volume-bfe97779-863c-431c-9bec-824bb78b1159 (bfe97779-863c-431c-9bec-824bb78b1159): created successfully Jul 24 15:44:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a884124-cb0e-4a4e-b007-563ecd8712a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Flow 'volume_create_manager' (b864a4ba-2c37-4a5f-bad5-2d04ba0966c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:09 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3fefd7b4-1430-40ca-9b8d-c963d54639c2 tempest-ServerActionsTestOtherA-1098513822 None] Created volume successfully. Jul 24 15:44:19 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:44:19 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:44:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Acquiring lock "cinder-311abd92-7a1d-4572-94d6-26a31d4713b9-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Lock "cinder-311abd92-7a1d-4572-94d6-26a31d4713b9-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Acquiring lock "cinder-quobyte-311abd92-7a1d-4572-94d6-26a31d4713b9" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Lock "cinder-quobyte-311abd92-7a1d-4572-94d6-26a31d4713b9" acquired by "delete_volume" :: waited 0.042s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:28 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f18a22c-56d5-4cd1-ab8e-6b17f3be4d94]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-311abd92-7a1d-4572-94d6-26a31d4713b9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:28 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-311abd92-7a1d-4572-94d6-26a31d4713b9 Jul 24 15:44:28 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:29 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-311abd92-7a1d-4572-94d6-26a31d4713b9" returned: 0 in 1.209s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-311abd92-7a1d-4572-94d6-26a31d4713b9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:29 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-311abd92-7a1d-4572-94d6-26a31d4713b9 Jul 24 15:44:29 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Flow 'volume_create_manager' (18119703-cbcc-4087-9f94-3579b15facdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45518248-bb1b-477d-8b24-fc25bce7efa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45518248-bb1b-477d-8b24-fc25bce7efa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1963793928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb522e7c-bd49-42a9-b389-7c809489441f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd9ee6d466b64f2d8c9471f03415ccb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:30Z,use_quota=True,user_id='34210a9cdc784cb1bb5bd5b82bee62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde1393a-b361-4e5f-89f4-0eaa66e0cb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde1393a-b361-4e5f-89f4-0eaa66e0cb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb2f504-1bb1-4e02-85af-7bb38fde9bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb2f504-1bb1-4e02-85af-7bb38fde9bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb522e7c-bd49-42a9-b389-7c809489441f', 'volume_name': 'volume-cb522e7c-bd49-42a9-b389-7c809489441f', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e2482c-7fca-47f8-ba1d-906696e27cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e2482c-7fca-47f8-ba1d-906696e27cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65b9683-1a7f-4d7b-8b19-0877a767ef0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:29 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Volume cb522e7c-bd49-42a9-b389-7c809489441f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb522e7c-bd49-42a9-b389-7c809489441f', 'volume_size': 1} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:44:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1963793928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb522e7c-bd49-42a9-b389-7c809489441f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd9ee6d466b64f2d8c9471f03415ccb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:44:30Z,use_quota=True,user_id='34210a9cdc784cb1bb5bd5b82bee62ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Creating volume cb522e7c-bd49-42a9-b389-7c809489441f {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:44:29 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb522e7c-bd49-42a9-b389-7c809489441f 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:29 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb522e7c-bd49-42a9-b389-7c809489441f 1073741824 Jul 24 15:44:29 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:29 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-311abd92-7a1d-4572-94d6-26a31d4713b9" returned: 0 in 0.564s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Lock "cinder-quobyte-311abd92-7a1d-4572-94d6-26a31d4713b9" released by "delete_volume" :: held 1.890s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:30 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Created reservations ['c5216107-7d27-4620-9e61-91f28481f1e2', '2bb182ea-5fc7-4ed5-9ed8-441eb709ab22', '54ab8158-188b-40c3-8fed-51bd7471baf4', 'd5703dfc-af6c-4a10-9b03-38e67404fbde'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:44:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:30 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:44:30 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:30 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.522s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:30 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:44:30 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Deleted volume successfully. Jul 24 15:44:30 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb522e7c-bd49-42a9-b389-7c809489441f 1073741824" returned: 0 in 1.131s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8b978a8c-b975-453b-90ef-af5776a2ab47 tempest-AttachVolumeShelveTestJSON-180900870 None] Lock "cinder-311abd92-7a1d-4572-94d6-26a31d4713b9-delete_volume" released by "delete_volume" :: held 3.077s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb522e7c-bd49-42a9-b389-7c809489441f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:31 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb522e7c-bd49-42a9-b389-7c809489441f Jul 24 15:44:31 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:31 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb522e7c-bd49-42a9-b389-7c809489441f" returned: 0 in 0.431s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:44:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:31 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65b9683-1a7f-4d7b-8b19-0877a767ef0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb522e7c-bd49-42a9-b389-7c809489441f', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:31 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ced565-85ca-4d29-8685-2b16b33695eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:44:31 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Volume volume-cb522e7c-bd49-42a9-b389-7c809489441f (cb522e7c-bd49-42a9-b389-7c809489441f): created successfully Jul 24 15:44:31 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ced565-85ca-4d29-8685-2b16b33695eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:44:31 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Flow 'volume_create_manager' (18119703-cbcc-4087-9f94-3579b15facdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:44:31 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3f1d1940-1de8-4586-945e-205cdc253dc2 tempest-ServerRescueNegativeTestJSON-131561161 None] Created volume successfully. Jul 24 15:44:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:44:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:40 devstack sudo[91185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:44:40 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:40 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.635s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:44:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:44:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 8 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:44:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:44:41 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:44:41 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=2 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:44:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-7c99cea4-ad9b-41fa-8fa3-d351b100688b req-6443e1b0-3234-4f55-bf70-a58f55a6cbdf tempest-TaggedAttachmentsTest-1944421502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-7c99cea4-ad9b-41fa-8fa3-d351b100688b req-6443e1b0-3234-4f55-bf70-a58f55a6cbdf tempest-TaggedAttachmentsTest-1944421502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-7c99cea4-ad9b-41fa-8fa3-d351b100688b req-6443e1b0-3234-4f55-bf70-a58f55a6cbdf tempest-TaggedAttachmentsTest-1944421502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-7c99cea4-ad9b-41fa-8fa3-d351b100688b req-6443e1b0-3234-4f55-bf70-a58f55a6cbdf tempest-TaggedAttachmentsTest-1944421502 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-c548be01-a5e5-44ca-9033-235f561e3f30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '241a4893-6e80-4356-9cba-a777b934928b', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:44:46 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-7c99cea4-ad9b-41fa-8fa3-d351b100688b req-6443e1b0-3234-4f55-bf70-a58f55a6cbdf tempest-TaggedAttachmentsTest-1944421502 None] attachment_update completed successfully. Jul 24 15:44:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Acquiring lock "cinder-cb522e7c-bd49-42a9-b389-7c809489441f-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Lock "cinder-cb522e7c-bd49-42a9-b389-7c809489441f-delete_volume" acquired by "delete_volume" :: waited 0.153s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:51 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-ff1a66b0-04f2-488a-96da-f21ae25974be req-4b9aa664-ca15-4ef1-8a5b-c43ccae91d8e tempest-TaggedAttachmentsTest-1944421502 None] Terminate volume connection completed successfully. Jul 24 15:44:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-ff1a66b0-04f2-488a-96da-f21ae25974be req-4b9aa664-ca15-4ef1-8a5b-c43ccae91d8e tempest-TaggedAttachmentsTest-1944421502 None] Deleting attachment 241a4893-6e80-4356-9cba-a777b934928b. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:44:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Acquiring lock "cinder-quobyte-cb522e7c-bd49-42a9-b389-7c809489441f" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:44:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Lock "cinder-quobyte-cb522e7c-bd49-42a9-b389-7c809489441f" acquired by "delete_volume" :: waited 0.087s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:44:52 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[91224abf-203b-4eb7-bdd1-5a19e1c41f12]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:44:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb522e7c-bd49-42a9-b389-7c809489441f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:52 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb522e7c-bd49-42a9-b389-7c809489441f Jul 24 15:44:52 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:53 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb522e7c-bd49-42a9-b389-7c809489441f" returned: 0 in 1.203s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb522e7c-bd49-42a9-b389-7c809489441f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:53 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb522e7c-bd49-42a9-b389-7c809489441f Jul 24 15:44:53 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:54 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb522e7c-bd49-42a9-b389-7c809489441f" returned: 0 in 1.231s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Lock "cinder-quobyte-cb522e7c-bd49-42a9-b389-7c809489441f" released by "delete_volume" :: held 2.657s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:44:54 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Created reservations ['768e54ea-a4f6-4ce2-86c6-fcd9e48a931a', '9c7807c8-292a-46f6-a1b4-299e52aca9e9', 'c50c6040-93b2-46b1-a43a-4cbde8d93437', '7a984f4d-d233-46e7-9d4c-7a84a4ce1274'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:44:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:44:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:44:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:44:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:44:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:44:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:44:55 devstack sudo[91880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:44:55 devstack sudo[91880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:44:55 devstack sudo[91880]: pam_unix(sudo:session): session closed for user root Jul 24 15:44:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.782s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:44:55 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:44:55 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Deleted volume successfully. Jul 24 15:44:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ed434bff-80f9-401b-afc9-5d5ee76d4378 tempest-ServerRescueNegativeTestJSON-131561161 None] Lock "cinder-cb522e7c-bd49-42a9-b389-7c809489441f-delete_volume" released by "delete_volume" :: held 4.075s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-4a66a0b6-297c-4218-a574-0721f80db823 req-f46d752c-ac6f-40e7-883d-b866d3414473 tempest-ServerActionsTestOtherA-1098513822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-4a66a0b6-297c-4218-a574-0721f80db823 req-f46d752c-ac6f-40e7-883d-b866d3414473 tempest-ServerActionsTestOtherA-1098513822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-4a66a0b6-297c-4218-a574-0721f80db823 req-f46d752c-ac6f-40e7-883d-b866d3414473 tempest-ServerActionsTestOtherA-1098513822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-4a66a0b6-297c-4218-a574-0721f80db823 req-f46d752c-ac6f-40e7-883d-b866d3414473 tempest-ServerActionsTestOtherA-1098513822 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-bfe97779-863c-431c-9bec-824bb78b1159', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd0e31e8-8c14-4aa4-aa25-c18f14071152', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:45:03 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-4a66a0b6-297c-4218-a574-0721f80db823 req-f46d752c-ac6f-40e7-883d-b866d3414473 tempest-ServerActionsTestOtherA-1098513822 None] attachment_update completed successfully. Jul 24 15:45:09 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-f9c3e88d-9c0e-46e8-b3c5-5db49205aa59 req-aa36964e-9a08-47bc-8389-fad8ccbf8371 tempest-ServerActionsTestOtherA-1098513822 None] Terminate volume connection completed successfully. Jul 24 15:45:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-f9c3e88d-9c0e-46e8-b3c5-5db49205aa59 req-aa36964e-9a08-47bc-8389-fad8ccbf8371 tempest-ServerActionsTestOtherA-1098513822 None] Deleting attachment bd0e31e8-8c14-4aa4-aa25-c18f14071152. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:45:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-f9c3e88d-9c0e-46e8-b3c5-5db49205aa59 req-0cef4420-e1b1-4853-ac92-984cc5f6d038 tempest-ServerActionsTestOtherA-1098513822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-f9c3e88d-9c0e-46e8-b3c5-5db49205aa59 req-0cef4420-e1b1-4853-ac92-984cc5f6d038 tempest-ServerActionsTestOtherA-1098513822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-f9c3e88d-9c0e-46e8-b3c5-5db49205aa59 req-0cef4420-e1b1-4853-ac92-984cc5f6d038 tempest-ServerActionsTestOtherA-1098513822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-f9c3e88d-9c0e-46e8-b3c5-5db49205aa59 req-0cef4420-e1b1-4853-ac92-984cc5f6d038 tempest-ServerActionsTestOtherA-1098513822 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-bfe97779-863c-431c-9bec-824bb78b1159', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e33c1227-6643-4558-9cbb-9ce19e7b15a3', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:45:10 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-f9c3e88d-9c0e-46e8-b3c5-5db49205aa59 req-0cef4420-e1b1-4853-ac92-984cc5f6d038 tempest-ServerActionsTestOtherA-1098513822 None] attachment_update completed successfully. Jul 24 15:45:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Acquiring lock "cinder-c548be01-a5e5-44ca-9033-235f561e3f30-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Lock "cinder-c548be01-a5e5-44ca-9033-235f561e3f30-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Acquiring lock "cinder-quobyte-c548be01-a5e5-44ca-9033-235f561e3f30" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Lock "cinder-quobyte-c548be01-a5e5-44ca-9033-235f561e3f30" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:14 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[353372b1-d2a9-4c40-8b26-a3cbfaad3f7b]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c548be01-a5e5-44ca-9033-235f561e3f30 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:15 devstack sudo[92940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c548be01-a5e5-44ca-9033-235f561e3f30 Jul 24 15:45:15 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:15 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c548be01-a5e5-44ca-9033-235f561e3f30" returned: 0 in 0.700s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c548be01-a5e5-44ca-9033-235f561e3f30 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:15 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c548be01-a5e5-44ca-9033-235f561e3f30 Jul 24 15:45:15 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:16 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c548be01-a5e5-44ca-9033-235f561e3f30" returned: 0 in 0.459s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Lock "cinder-quobyte-c548be01-a5e5-44ca-9033-235f561e3f30" released by "delete_volume" :: held 1.234s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:16 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Created reservations ['3a01f515-9cdb-4951-bec2-6f18c7c75a2c', 'a1fa5200-e807-4be5-bfa2-d98ca7be155f', 'de0530d8-26ac-4ece-be14-0810fcddfca6', 'c77b2fd9-aec1-419c-ac7f-426c071d0b95'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:45:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:16 devstack sudo[92953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:45:16 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:16 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.437s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:16 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:45:17 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Deleted volume successfully. Jul 24 15:45:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-67e971d2-a8ae-460b-b3fc-a9c708d212de tempest-TaggedAttachmentsTest-1944421502 None] Lock "cinder-c548be01-a5e5-44ca-9033-235f561e3f30-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:26 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=28,cinder:UPDATE=25,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:45:35 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=36,cinder:INSERT=5,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:45:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:45:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:40 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:45:40 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:40 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-ba1a625f-b5b8-4a89-8efb-7eca2e21c1b6 req-e3395f22-2124-4622-aadf-a14db4316179 tempest-ServerActionsTestOtherA-1098513822 None] Terminate volume connection completed successfully. Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-ba1a625f-b5b8-4a89-8efb-7eca2e21c1b6 req-e3395f22-2124-4622-aadf-a14db4316179 tempest-ServerActionsTestOtherA-1098513822 None] Deleting attachment e33c1227-6643-4558-9cbb-9ce19e7b15a3. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:45:40 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.393s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 8 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Flow 'volume_create_manager' (3f9119c9-38fe-449f-a976-b11c30757ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2228b02-850b-4984-bb4d-5edc586a5fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2228b02-850b-4984-bb4d-5edc586a5fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1733778345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c369a7ac-c441-4ea5-8107-321fd64e072e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c5b3172a80c41d58a09e827a47ff0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:40Z,use_quota=True,user_id='604cd3fb445848e985b7b8fd77102a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd294c32-743a-4482-ba87-2085a40a4cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd294c32-743a-4482-ba87-2085a40a4cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8870338f-533b-4885-98b7-1727d5692ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8870338f-533b-4885-98b7-1727d5692ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c369a7ac-c441-4ea5-8107-321fd64e072e', 'volume_name': 'volume-c369a7ac-c441-4ea5-8107-321fd64e072e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76e68ec-5399-433f-8eaa-08579fb368e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76e68ec-5399-433f-8eaa-08579fb368e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72468f4-702a-461c-988b-846208cc9c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:40 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Volume c369a7ac-c441-4ea5-8107-321fd64e072e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c369a7ac-c441-4ea5-8107-321fd64e072e', 'volume_size': 1} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1733778345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c369a7ac-c441-4ea5-8107-321fd64e072e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3c5b3172a80c41d58a09e827a47ff0e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:40Z,use_quota=True,user_id='604cd3fb445848e985b7b8fd77102a76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Creating volume c369a7ac-c441-4ea5-8107-321fd64e072e {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:45:40 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:45:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c369a7ac-c441-4ea5-8107-321fd64e072e 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:40 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c369a7ac-c441-4ea5-8107-321fd64e072e 1073741824 Jul 24 15:45:40 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:41 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c369a7ac-c441-4ea5-8107-321fd64e072e 1073741824" returned: 0 in 0.566s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c369a7ac-c441-4ea5-8107-321fd64e072e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:41 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c369a7ac-c441-4ea5-8107-321fd64e072e Jul 24 15:45:41 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:41 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c369a7ac-c441-4ea5-8107-321fd64e072e" returned: 0 in 0.363s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:45:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72468f4-702a-461c-988b-846208cc9c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c369a7ac-c441-4ea5-8107-321fd64e072e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02891600-4c0f-4b6f-88dd-c9e8a8676535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:41 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Volume volume-c369a7ac-c441-4ea5-8107-321fd64e072e (c369a7ac-c441-4ea5-8107-321fd64e072e): created successfully Jul 24 15:45:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02891600-4c0f-4b6f-88dd-c9e8a8676535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Flow 'volume_create_manager' (3f9119c9-38fe-449f-a976-b11c30757ea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:41 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-c913c938-fde0-4d78-9775-a244195d38d2 req-d7f0ae47-30d1-4c91-b0ab-a6bd2a4961bb tempest-VolumesGetTestJSON-1124881964 None] Created volume successfully. Jul 24 15:45:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Acquiring lock "cinder-c369a7ac-c441-4ea5-8107-321fd64e072e-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Lock "cinder-c369a7ac-c441-4ea5-8107-321fd64e072e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Acquiring lock "cinder-quobyte-c369a7ac-c441-4ea5-8107-321fd64e072e" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Lock "cinder-quobyte-c369a7ac-c441-4ea5-8107-321fd64e072e" acquired by "delete_volume" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:43 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfd27b5-8acb-4e0d-8f4d-c94542886f3a]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c369a7ac-c441-4ea5-8107-321fd64e072e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:43 devstack sudo[93224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c369a7ac-c441-4ea5-8107-321fd64e072e Jul 24 15:45:43 devstack sudo[93224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:43 devstack sudo[93224]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c369a7ac-c441-4ea5-8107-321fd64e072e" returned: 0 in 0.557s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c369a7ac-c441-4ea5-8107-321fd64e072e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:43 devstack sudo[93238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c369a7ac-c441-4ea5-8107-321fd64e072e Jul 24 15:45:43 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:44 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c369a7ac-c441-4ea5-8107-321fd64e072e" returned: 0 in 0.340s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Lock "cinder-quobyte-c369a7ac-c441-4ea5-8107-321fd64e072e" released by "delete_volume" :: held 0.976s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:44 devstack cinder-volume[88350]: DEBUG cinder.quota [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Created reservations ['5a0657f2-81d4-46ad-9836-e3aa3e816c7e', '195cc702-6b3f-4af4-943e-ceea6d3dcea3', '2aca5a4c-dfd7-4137-a2b6-32a19dc32e52', '9e87fddf-d4d6-4713-944a-fe56703516bd'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:45:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:44 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:45:44 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:44 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.362s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:44 devstack cinder-volume[88350]: DEBUG cinder.manager [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:45:44 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Deleted volume successfully. Jul 24 15:45:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-d1a2b3df-2b13-41fc-8734-f1eb25f9c967 req-95bc3ef6-63f5-428d-9aeb-61dfc24e6dd2 tempest-VolumesGetTestJSON-1124881964 None] Lock "cinder-c369a7ac-c441-4ea5-8107-321fd64e072e-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Acquiring lock "cinder-bfe97779-863c-431c-9bec-824bb78b1159-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Lock "cinder-bfe97779-863c-431c-9bec-824bb78b1159-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Acquiring lock "cinder-quobyte-bfe97779-863c-431c-9bec-824bb78b1159" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:45:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Lock "cinder-quobyte-bfe97779-863c-431c-9bec-824bb78b1159" acquired by "delete_volume" :: waited 0.037s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:45:45 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2da1f63-cc7f-47aa-b3c3-8ad78f841471]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:45:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bfe97779-863c-431c-9bec-824bb78b1159 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:45 devstack sudo[93246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bfe97779-863c-431c-9bec-824bb78b1159 Jul 24 15:45:45 devstack sudo[93246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:46 devstack sudo[93246]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bfe97779-863c-431c-9bec-824bb78b1159" returned: 0 in 0.762s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bfe97779-863c-431c-9bec-824bb78b1159 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:46 devstack sudo[93262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bfe97779-863c-431c-9bec-824bb78b1159 Jul 24 15:45:46 devstack sudo[93262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:46 devstack sudo[93262]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bfe97779-863c-431c-9bec-824bb78b1159" returned: 0 in 0.564s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Lock "cinder-quobyte-bfe97779-863c-431c-9bec-824bb78b1159" released by "delete_volume" :: held 1.399s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:47 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Created reservations ['e32411f9-bf98-4822-835d-efcdaf45d278', '8966b90c-d9df-4b51-8be8-5c8db354725b', '9bb10322-49d0-433a-b6f1-99b62f9664e0', '6c8e422a-85d3-4fd6-8f79-4c9ab822eed3'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:45:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:47 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:45:47 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:47 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.337s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:47 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:45:47 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Deleted volume successfully. Jul 24 15:45:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ed991942-559e-4bfc-87d9-509c65ff76e8 tempest-ServerActionsTestOtherA-1098513822 None] Lock "cinder-bfe97779-863c-431c-9bec-824bb78b1159-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Flow 'volume_create_manager' (88bc2359-ed4c-4a97-b8d6-237c64a7f7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4559d0f-6ed1-48c1-aef3-b5e4f208d6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4559d0f-6ed1-48c1-aef3-b5e4f208d6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-101825793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d365b0-7b1b-4828-a73e-0ec39b763b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0beb62107bec45bab0c03ad33afc97a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:52Z,use_quota=True,user_id='7b93d4a9331645ca9206eb72eb919b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9859398-e974-43c7-b106-37dffac8bf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9859398-e974-43c7-b106-37dffac8bf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ace7162-767c-4678-a516-80ba6876878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ace7162-767c-4678-a516-80ba6876878c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09d365b0-7b1b-4828-a73e-0ec39b763b34', 'volume_name': 'volume-09d365b0-7b1b-4828-a73e-0ec39b763b34', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314c623e-9209-418d-b87e-711ebca39067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314c623e-9209-418d-b87e-711ebca39067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606dd368-b15f-4011-89b5-5360833184a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:52 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Volume 09d365b0-7b1b-4828-a73e-0ec39b763b34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09d365b0-7b1b-4828-a73e-0ec39b763b34', 'volume_size': 1} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-101825793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d365b0-7b1b-4828-a73e-0ec39b763b34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0beb62107bec45bab0c03ad33afc97a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:52Z,use_quota=True,user_id='7b93d4a9331645ca9206eb72eb919b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Creating volume 09d365b0-7b1b-4828-a73e-0ec39b763b34 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:45:52 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-09d365b0-7b1b-4828-a73e-0ec39b763b34 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:52 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-09d365b0-7b1b-4828-a73e-0ec39b763b34 1073741824 Jul 24 15:45:52 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Flow 'volume_create_manager' (f0137565-0940-4bc7-a466-f2cdc28d0f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13169d2-67e7-4c0f-bf0f-1def002d36cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13169d2-67e7-4c0f-bf0f-1def002d36cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1391997392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794208be-0568-4053-af5c-e2a0bb58c881,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31ee8cdcbfa04338923aa18b5726a23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:52Z,use_quota=True,user_id='c86c1454e3f3461188f7972e7e0645dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0bc593c-d153-420b-9b89-ffec33cbede1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0bc593c-d153-420b-9b89-ffec33cbede1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2d241c-d829-4e3d-b18a-8f3ef890f794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2d241c-d829-4e3d-b18a-8f3ef890f794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794208be-0568-4053-af5c-e2a0bb58c881', 'volume_name': 'volume-794208be-0568-4053-af5c-e2a0bb58c881', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1c12bf-5156-4ca6-9574-fec2644339a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1c12bf-5156-4ca6-9574-fec2644339a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d451716-d3ef-45bf-8146-65345e00d467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:52 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Volume 794208be-0568-4053-af5c-e2a0bb58c881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794208be-0568-4053-af5c-e2a0bb58c881', 'volume_size': 1} Jul 24 15:45:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:53 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-09d365b0-7b1b-4828-a73e-0ec39b763b34 1073741824" returned: 0 in 0.982s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-09d365b0-7b1b-4828-a73e-0ec39b763b34 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:53 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-09d365b0-7b1b-4828-a73e-0ec39b763b34 Jul 24 15:45:53 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:53 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-09d365b0-7b1b-4828-a73e-0ec39b763b34" returned: 0 in 0.354s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.877s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1391997392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794208be-0568-4053-af5c-e2a0bb58c881,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31ee8cdcbfa04338923aa18b5726a23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:52Z,use_quota=True,user_id='c86c1454e3f3461188f7972e7e0645dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Creating volume 794208be-0568-4053-af5c-e2a0bb58c881 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:45:53 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-794208be-0568-4053-af5c-e2a0bb58c881 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606dd368-b15f-4011-89b5-5360833184a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09d365b0-7b1b-4828-a73e-0ec39b763b34', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b5cf5f-b476-45cc-9c5e-d6720bf4d0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:53 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-794208be-0568-4053-af5c-e2a0bb58c881 1073741824 Jul 24 15:45:53 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:53 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Volume volume-09d365b0-7b1b-4828-a73e-0ec39b763b34 (09d365b0-7b1b-4828-a73e-0ec39b763b34): created successfully Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b5cf5f-b476-45cc-9c5e-d6720bf4d0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Flow 'volume_create_manager' (88bc2359-ed4c-4a97-b8d6-237c64a7f7bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:53 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-5dd09088-6cae-43da-9cdd-bc0d489e4c9d tempest-AttachVolumeTestJSON-255636830 None] Created volume successfully. Jul 24 15:45:54 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-794208be-0568-4053-af5c-e2a0bb58c881 1073741824" returned: 0 in 0.651s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-794208be-0568-4053-af5c-e2a0bb58c881 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:54 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-794208be-0568-4053-af5c-e2a0bb58c881 Jul 24 15:45:54 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:54 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-794208be-0568-4053-af5c-e2a0bb58c881" returned: 0 in 0.406s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:45:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d451716-d3ef-45bf-8146-65345e00d467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794208be-0568-4053-af5c-e2a0bb58c881', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1f8deb-3f04-4266-a4e5-3ee0e4a245cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:54 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Volume volume-794208be-0568-4053-af5c-e2a0bb58c881 (794208be-0568-4053-af5c-e2a0bb58c881): created successfully Jul 24 15:45:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d1f8deb-3f04-4266-a4e5-3ee0e4a245cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Flow 'volume_create_manager' (f0137565-0940-4bc7-a466-f2cdc28d0f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:54 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-126bbd77-7f93-43fd-be5a-0123485e1fab tempest-VolumesTestJSON-1516131649 None] Created volume successfully. Jul 24 15:45:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-1955db56-5900-4d1b-b2be-354d82e4f16d req-465f4cff-7f85-49e5-a16c-5f0f5928def4 tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-1955db56-5900-4d1b-b2be-354d82e4f16d req-465f4cff-7f85-49e5-a16c-5f0f5928def4 tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-1955db56-5900-4d1b-b2be-354d82e4f16d req-465f4cff-7f85-49e5-a16c-5f0f5928def4 tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-1955db56-5900-4d1b-b2be-354d82e4f16d req-465f4cff-7f85-49e5-a16c-5f0f5928def4 tempest-AttachVolumeTestJSON-255636830 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-09d365b0-7b1b-4828-a73e-0ec39b763b34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92f9e4b0-ac16-4b21-9f3f-348df909a67b', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:45:55 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-1955db56-5900-4d1b-b2be-354d82e4f16d req-465f4cff-7f85-49e5-a16c-5f0f5928def4 tempest-AttachVolumeTestJSON-255636830 None] attachment_update completed successfully. Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Flow 'volume_create_manager' (9291a4b9-55e8-4b26-af48-9ff4c619960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b704ce-9fcf-4a87-935c-13a188bcdb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b704ce-9fcf-4a87-935c-13a188bcdb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-283629492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d0cfa8-cb08-4db9-acd5-de4961a6b763,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31ee8cdcbfa04338923aa18b5726a23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:57Z,use_quota=True,user_id='c86c1454e3f3461188f7972e7e0645dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bcad6e-f2d1-423e-81c4-87fc6f7fff33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57bcad6e-f2d1-423e-81c4-87fc6f7fff33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621ba69d-19a9-4310-b60a-1887faf41e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621ba69d-19a9-4310-b60a-1887faf41e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51d0cfa8-cb08-4db9-acd5-de4961a6b763', 'volume_name': 'volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc4637a-9d2a-4458-bd11-46caedf8063d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc4637a-9d2a-4458-bd11-46caedf8063d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97cb0ba-17fe-409d-91c1-55327e913f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:56 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Volume 51d0cfa8-cb08-4db9-acd5-de4961a6b763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763', 'volume_size': 1} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-283629492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51d0cfa8-cb08-4db9-acd5-de4961a6b763,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31ee8cdcbfa04338923aa18b5726a23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:57Z,use_quota=True,user_id='c86c1454e3f3461188f7972e7e0645dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Creating volume 51d0cfa8-cb08-4db9-acd5-de4961a6b763 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:45:56 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:45:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:56 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763 1073741824 Jul 24 15:45:56 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:57 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763 1073741824" returned: 0 in 0.568s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:57 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763 Jul 24 15:45:57 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:45:57 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Jul 24 15:45:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763" returned: 0 in 0.457s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:45:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:45:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97cb0ba-17fe-409d-91c1-55327e913f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e266e1-112e-441b-b15c-344be4f7c3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:57 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Volume volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763 (51d0cfa8-cb08-4db9-acd5-de4961a6b763): created successfully Jul 24 15:45:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e266e1-112e-441b-b15c-344be4f7c3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Flow 'volume_create_manager' (9291a4b9-55e8-4b26-af48-9ff4c619960d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:57 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2ea983bd-9856-483f-bd66-20f13394f427 tempest-VolumesTestJSON-1516131649 None] Created volume successfully. Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Flow 'volume_create_manager' (924b393b-f4c7-4c6c-85c4-e2255a1515f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d3a062-a742-4636-a28a-80f2cc8e3fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d3a062-a742-4636-a28a-80f2cc8e3fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2067841395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4762619-8730-4c64-918b-b8494e1b37eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31ee8cdcbfa04338923aa18b5726a23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:59Z,use_quota=True,user_id='c86c1454e3f3461188f7972e7e0645dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98967cf-0ac5-4225-b436-24b858c13de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98967cf-0ac5-4225-b436-24b858c13de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9469565-5981-4c1a-8e62-a533ab559a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9469565-5981-4c1a-8e62-a533ab559a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4762619-8730-4c64-918b-b8494e1b37eb', 'volume_name': 'volume-f4762619-8730-4c64-918b-b8494e1b37eb', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b003d50-b326-433e-a98c-c1d1f1f0de69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b003d50-b326-433e-a98c-c1d1f1f0de69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e156551b-3cba-4f94-b308-3972def9db00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:45:59 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Volume f4762619-8730-4c64-918b-b8494e1b37eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4762619-8730-4c64-918b-b8494e1b37eb', 'volume_size': 1} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2067841395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4762619-8730-4c64-918b-b8494e1b37eb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='31ee8cdcbfa04338923aa18b5726a23b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:45:59Z,use_quota=True,user_id='c86c1454e3f3461188f7972e7e0645dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Creating volume f4762619-8730-4c64-918b-b8494e1b37eb {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:45:59 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:45:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f4762619-8730-4c64-918b-b8494e1b37eb 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:45:59 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f4762619-8730-4c64-918b-b8494e1b37eb 1073741824 Jul 24 15:45:59 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:00 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f4762619-8730-4c64-918b-b8494e1b37eb 1073741824" returned: 0 in 0.702s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f4762619-8730-4c64-918b-b8494e1b37eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:00 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f4762619-8730-4c64-918b-b8494e1b37eb Jul 24 15:46:00 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:00 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f4762619-8730-4c64-918b-b8494e1b37eb" returned: 0 in 0.280s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:46:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e156551b-3cba-4f94-b308-3972def9db00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4762619-8730-4c64-918b-b8494e1b37eb', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e60eb0-bf90-4e14-9c14-47eecb646859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:00 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Volume volume-f4762619-8730-4c64-918b-b8494e1b37eb (f4762619-8730-4c64-918b-b8494e1b37eb): created successfully Jul 24 15:46:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e60eb0-bf90-4e14-9c14-47eecb646859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Flow 'volume_create_manager' (924b393b-f4c7-4c6c-85c4-e2255a1515f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:46:00 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3eb95444-812f-4eca-8319-58f7d4316410 tempest-VolumesTestJSON-1516131649 None] Created volume successfully. Jul 24 15:46:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Acquiring lock "cinder-f4762619-8730-4c64-918b-b8494e1b37eb-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Lock "cinder-f4762619-8730-4c64-918b-b8494e1b37eb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Acquiring lock "cinder-quobyte-f4762619-8730-4c64-918b-b8494e1b37eb" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Lock "cinder-quobyte-f4762619-8730-4c64-918b-b8494e1b37eb" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:03 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec3a902-8e93-43e2-917c-0869bc93f097]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f4762619-8730-4c64-918b-b8494e1b37eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:04 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f4762619-8730-4c64-918b-b8494e1b37eb Jul 24 15:46:04 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:04 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f4762619-8730-4c64-918b-b8494e1b37eb" returned: 0 in 0.469s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f4762619-8730-4c64-918b-b8494e1b37eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:04 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f4762619-8730-4c64-918b-b8494e1b37eb Jul 24 15:46:04 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:04 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f4762619-8730-4c64-918b-b8494e1b37eb" returned: 0 in 0.340s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Lock "cinder-quobyte-f4762619-8730-4c64-918b-b8494e1b37eb" released by "delete_volume" :: held 0.874s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:04 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Created reservations ['45f3cc1e-bc5a-4145-a332-9ab5fb8a0b08', '8393b6fa-df5f-42a6-9008-3abd229d8e19', 'c4c2696b-7335-45bd-aa3e-b62a3860f6f3', 'dbbfea68-d1f2-474b-9c29-baf2acce79dc'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Acquiring lock "cinder-51d0cfa8-cb08-4db9-acd5-de4961a6b763-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Lock "cinder-51d0cfa8-cb08-4db9-acd5-de4961a6b763-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:05 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:46:05 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Acquiring lock "cinder-quobyte-51d0cfa8-cb08-4db9-acd5-de4961a6b763" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Lock "cinder-quobyte-51d0cfa8-cb08-4db9-acd5-de4961a6b763" acquired by "delete_volume" :: waited 0.049s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b72092-09eb-4f31-9fd3-f96a5ef10e64]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:05 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763 Jul 24 15:46:05 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:05 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.516s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:46:05 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Deleted volume successfully. Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f2f81171-36eb-4039-873a-91114166fe7c tempest-VolumesTestJSON-1516131649 None] Lock "cinder-f4762619-8730-4c64-918b-b8494e1b37eb-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:05 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763" returned: 0 in 0.665s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:06 devstack sudo[94442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763 Jul 24 15:46:06 devstack sudo[94442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:06 devstack sudo[94442]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-51d0cfa8-cb08-4db9-acd5-de4961a6b763" returned: 0 in 0.370s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Lock "cinder-quobyte-51d0cfa8-cb08-4db9-acd5-de4961a6b763" released by "delete_volume" :: held 1.106s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:06 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Created reservations ['b2b08d2c-1f25-4ec3-9d5b-1a535f46eb81', 'cf311e85-d13b-402b-be87-adf7b4d1dce6', '475d669b-8d29-4ddb-ad3a-0ae4a771a67a', '52c8a2cc-95dd-4220-86d6-68ca708cccf6'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:46:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:46:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:46:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:06 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:46:06 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:06 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.276s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:06 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:46:06 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Deleted volume successfully. Jul 24 15:46:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7faed73e-8006-417d-a0cd-2028cd8918be tempest-VolumesTestJSON-1516131649 None] Lock "cinder-51d0cfa8-cb08-4db9-acd5-de4961a6b763-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Acquiring lock "cinder-794208be-0568-4053-af5c-e2a0bb58c881-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Lock "cinder-794208be-0568-4053-af5c-e2a0bb58c881-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Acquiring lock "cinder-quobyte-794208be-0568-4053-af5c-e2a0bb58c881" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Lock "cinder-quobyte-794208be-0568-4053-af5c-e2a0bb58c881" acquired by "delete_volume" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:07 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0daf10b7-591e-4ebd-9fb8-791197b32551]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-794208be-0568-4053-af5c-e2a0bb58c881 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:07 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-794208be-0568-4053-af5c-e2a0bb58c881 Jul 24 15:46:07 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:08 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-794208be-0568-4053-af5c-e2a0bb58c881" returned: 0 in 0.460s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-794208be-0568-4053-af5c-e2a0bb58c881 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:08 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-794208be-0568-4053-af5c-e2a0bb58c881 Jul 24 15:46:08 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:08 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-794208be-0568-4053-af5c-e2a0bb58c881" returned: 0 in 0.294s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Lock "cinder-quobyte-794208be-0568-4053-af5c-e2a0bb58c881" released by "delete_volume" :: held 0.813s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:08 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Created reservations ['5786a906-4848-4ae3-bc94-37660e299bc0', 'c1201527-72d3-43cf-969c-d730f234a7dc', 'ef8be82b-1822-4a7c-9c8e-8310d9ac14f5', 'b185642b-7d6d-407b-b4eb-ed96ccddbd15'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:46:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:46:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:46:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:08 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:46:08 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:09 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.436s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:09 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:46:09 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Deleted volume successfully. Jul 24 15:46:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c3088038-7857-4bdb-b5ac-4ab8ce2c5181 tempest-VolumesTestJSON-1516131649 None] Lock "cinder-794208be-0568-4053-af5c-e2a0bb58c881-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Flow 'volume_create_manager' (b301bf10-cf45-4355-b933-fcfedbfd5ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421c26f5-50ce-4736-8697-fd17bcb267fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (421c26f5-50ce-4736-8697-fd17bcb267fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1049423518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6497f924-07cf-4f75-b8b4-f0e8ec78e062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba17de3289db46469403f207bdd9877a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:46:14Z,use_quota=True,user_id='9bf314cec59347699e00152a45507da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ed6249-bf9b-4156-99cb-1016a29a9e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ed6249-bf9b-4156-99cb-1016a29a9e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d043927c-6fe5-4327-9a42-e898e48c59dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d043927c-6fe5-4327-9a42-e898e48c59dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6497f924-07cf-4f75-b8b4-f0e8ec78e062', 'volume_name': 'volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767b1122-a814-45ec-94b7-a247ed91303b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767b1122-a814-45ec-94b7-a247ed91303b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0ab775-dc41-4f48-bf3c-82af1ba9f863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:14 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Volume 6497f924-07cf-4f75-b8b4-f0e8ec78e062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062', 'volume_size': 1} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:46:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1049423518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6497f924-07cf-4f75-b8b4-f0e8ec78e062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba17de3289db46469403f207bdd9877a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:46:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:46:14Z,use_quota=True,user_id='9bf314cec59347699e00152a45507da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Creating volume 6497f924-07cf-4f75-b8b4-f0e8ec78e062 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:46:14 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:46:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:14 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062 1073741824 Jul 24 15:46:14 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:15 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062 1073741824" returned: 0 in 0.697s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:15 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062 Jul 24 15:46:15 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:15 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-285d7e41-f640-4bc6-8dbe-8bcc04581ad9 tempest-GroupSnapshotsV319Test-1706142089 None] Group tempest-GroupSnapshotsV319Test-Group-875317552: creating Jul 24 15:46:15 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-285d7e41-f640-4bc6-8dbe-8bcc04581ad9 tempest-GroupSnapshotsV319Test-1706142089 None] Group tempest-GroupSnapshotsV319Test-Group-875317552: created successfully Jul 24 15:46:15 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-285d7e41-f640-4bc6-8dbe-8bcc04581ad9 tempest-GroupSnapshotsV319Test-1706142089 None] Create group completed successfully. Jul 24 15:46:15 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062" returned: 0 in 0.466s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:46:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba0ab775-dc41-4f48-bf3c-82af1ba9f863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9784a95d-89d6-4f68-8c81-8614521a313d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:15 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Volume volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062 (6497f924-07cf-4f75-b8b4-f0e8ec78e062): created successfully Jul 24 15:46:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9784a95d-89d6-4f68-8c81-8614521a313d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Flow 'volume_create_manager' (b301bf10-cf45-4355-b933-fcfedbfd5ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:46:15 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2fbc38d2-3a3f-401f-bdfd-c119b65d52a7 tempest-AttachVolumeNegativeTest-1803157486 None] Created volume successfully. Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Flow 'volume_create_manager' (32f5920f-5aad-4b55-be16-4722bb7b4947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb7cb42-4f5d-4c98-9bc5-49658c406f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb7cb42-4f5d-4c98-9bc5-49658c406f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1383907318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=707963f4-891f-41be-8b6d-093136084829,host='devstack@QuobyteHD#QuobyteHD',id=2caa96e6-496f-4599-a55e-91b2a049aca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3136789be267459082d242e21fa7e2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:46:18Z,use_quota=True,user_id='6ee5a4e08f0140deb613b1ef792b7c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b16ea1aa-34a3-49b1-879a-329908808e99),volume_type_id=b16ea1aa-34a3-49b1-879a-329908808e99)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a700b02f-fd9d-4edd-85b1-9428d5997feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a700b02f-fd9d-4edd-85b1-9428d5997feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b200f8d-5a12-4030-b313-b678dd6f5e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b200f8d-5a12-4030-b313-b678dd6f5e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2caa96e6-496f-4599-a55e-91b2a049aca6', 'volume_name': 'volume-2caa96e6-496f-4599-a55e-91b2a049aca6', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ef660e-f707-4d85-a455-c9d1834ac9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ef660e-f707-4d85-a455-c9d1834ac9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73d44242-9c3c-4d51-9c99-5491835e9e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:17 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Volume 2caa96e6-496f-4599-a55e-91b2a049aca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2caa96e6-496f-4599-a55e-91b2a049aca6', 'volume_size': 1} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=707963f4-891f-41be-8b6d-093136084829,created_at=2026-07-24T13:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1383907318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=707963f4-891f-41be-8b6d-093136084829,host='devstack@QuobyteHD#QuobyteHD',id=2caa96e6-496f-4599-a55e-91b2a049aca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3136789be267459082d242e21fa7e2ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:46:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:46:18Z,use_quota=True,user_id='6ee5a4e08f0140deb613b1ef792b7c11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b16ea1aa-34a3-49b1-879a-329908808e99),volume_type_id=b16ea1aa-34a3-49b1-879a-329908808e99)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Creating volume 2caa96e6-496f-4599-a55e-91b2a049aca6 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:46:17 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:17 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6 1073741824 Jul 24 15:46:17 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-cc941f11-d218-45f7-979a-4a5b0b428c87 req-0a6ea108-ecaa-40a1-bd1f-98f1ca9f9481 tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:18 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6 1073741824" returned: 0 in 0.464s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:18 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6 Jul 24 15:46:18 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:18 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6" returned: 0 in 0.309s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:46:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-cc941f11-d218-45f7-979a-4a5b0b428c87 req-0a6ea108-ecaa-40a1-bd1f-98f1ca9f9481 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.752s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-cc941f11-d218-45f7-979a-4a5b0b428c87 req-0a6ea108-ecaa-40a1-bd1f-98f1ca9f9481 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73d44242-9c3c-4d51-9c99-5491835e9e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2caa96e6-496f-4599-a55e-91b2a049aca6', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d66c3a-df51-463a-9ea2-34a0cfa1a0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:18 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Volume volume-2caa96e6-496f-4599-a55e-91b2a049aca6 (2caa96e6-496f-4599-a55e-91b2a049aca6): created successfully Jul 24 15:46:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4d66c3a-df51-463a-9ea2-34a0cfa1a0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Flow 'volume_create_manager' (32f5920f-5aad-4b55-be16-4722bb7b4947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:46:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-cc941f11-d218-45f7-979a-4a5b0b428c87 req-0a6ea108-ecaa-40a1-bd1f-98f1ca9f9481 tempest-AttachVolumeNegativeTest-1803157486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '242c79d8-74d0-4301-98e4-16e1feaaf23e', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:46:18 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a3c8aec3-7431-4274-9322-5cb616dc87af tempest-GroupSnapshotsV319Test-1706142089 None] Created volume successfully. Jul 24 15:46:18 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-cc941f11-d218-45f7-979a-4a5b0b428c87 req-0a6ea108-ecaa-40a1-bd1f-98f1ca9f9481 tempest-AttachVolumeNegativeTest-1803157486 None] attachment_update completed successfully. Jul 24 15:46:19 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] GroupSnapshot 946cb8b7-f9f6-49a0-b3d9-ffd9a3b1121f: creating. Jul 24 15:46:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] Group snapshot 946cb8b7-f9f6-49a0-b3d9-ffd9a3b1121f: creating. {{(pid=88350) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 15:46:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] Creating offline snapshot f7fbbeee-0342-4018-b95a-a6794d117ab8 of volume 2caa96e6-496f-4599-a55e-91b2a049aca6 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:46:19 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ca0b50-4754-45f4-aef2-d243e321c31e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:19 devstack sudo[94521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6 Jul 24 15:46:19 devstack sudo[94521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:19 devstack sudo[94521]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6" returned: 0 in 0.507s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:19 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8 1G Jul 24 15:46:19 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:20 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8 1G" returned: 0 in 0.444s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2caa96e6-496f-4599-a55e-91b2a049aca6 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:20 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2caa96e6-496f-4599-a55e-91b2a049aca6 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8 Jul 24 15:46:20 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:20 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2caa96e6-496f-4599-a55e-91b2a049aca6 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8" returned: 0 in 0.344s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:20 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:46:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:20 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8 Jul 24 15:46:20 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:21 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8" returned: 0 in 0.321s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:21 devstack sudo[94546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.info Jul 24 15:46:21 devstack sudo[94546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:21 devstack sudo[94546]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.info" returned: 0 in 0.421s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:21 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:46:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:21 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.info Jul 24 15:46:21 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:21 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.info" returned: 0 in 0.362s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.514s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:22 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2b47f194-4bcb-42bc-ba1f-c807eea8cb84 tempest-GroupSnapshotsV319Test-1706142089 None] group_snapshot 946cb8b7-f9f6-49a0-b3d9-ffd9a3b1121f: created successfully Jul 24 15:46:23 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] group_snapshot 946cb8b7-f9f6-49a0-b3d9-ffd9a3b1121f: deleting Jul 24 15:46:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] group_snapshot 946cb8b7-f9f6-49a0-b3d9-ffd9a3b1121f: deleting {{(pid=88350) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 15:46:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] Acquiring lock "cinder-quobyte-2caa96e6-496f-4599-a55e-91b2a049aca6" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] Lock "cinder-quobyte-2caa96e6-496f-4599-a55e-91b2a049aca6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] Acquiring lock "cinder-quobyte-f7fbbeee-0342-4018-b95a-a6794d117ab8" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] Lock "cinder-quobyte-f7fbbeee-0342-4018-b95a-a6794d117ab8" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] Deleting offline snapshot f7fbbeee-0342-4018-b95a-a6794d117ab8 of volume 2caa96e6-496f-4599-a55e-91b2a049aca6 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:46:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] snapshot_file for this snap is: volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:46:23 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8226bc-c0c7-453c-b2dc-4e278226c2e9]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:23 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8 Jul 24 15:46:23 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:23 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8" returned: 0 in 0.624s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2caa96e6-496f-4599-a55e-91b2a049aca6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:46:23 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabd477e-0934-49ff-a71f-edd373d522f9]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:24 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6 Jul 24 15:46:24 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:24 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6" returned: 0 in 0.753s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:24 devstack sudo[94655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8 Jul 24 15:46:24 devstack sudo[94655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:25 devstack sudo[94655]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8" returned: 0 in 0.758s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:25 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8 Jul 24 15:46:25 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:25 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6.f7fbbeee-0342-4018-b95a-a6794d117ab8" returned: 0 in 0.421s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:25 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] Lock "cinder-quobyte-f7fbbeee-0342-4018-b95a-a6794d117ab8" released by "_delete_snapshot" :: held 2.739s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:25 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] Lock "cinder-quobyte-2caa96e6-496f-4599-a55e-91b2a049aca6" released by "delete_snapshot" :: held 2.769s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:26 devstack cinder-volume[88350]: WARNING cinder.quota [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1267235983 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1267235983, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:46:26 devstack cinder-volume[88350]: WARNING cinder.quota [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1267235983 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1267235983, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:46:26 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] Created reservations ['32a03081-7c84-459d-a873-5491d84886e3', 'ae91e339-bd79-4234-b7f9-57b659aaf872', '1811dbbc-97fb-43fa-affd-052f0bc3425f', '44f794f7-dc45-40c0-b97d-8b9afeb73a4e'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:46:26 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-20c6d3d4-e15d-47b1-9b4c-58142f109223 tempest-GroupSnapshotsV319Test-1706142089 None] group_snapshot 946cb8b7-f9f6-49a0-b3d9-ffd9a3b1121f: deleted successfully Jul 24 15:46:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Acquiring lock "cinder-quobyte-2caa96e6-496f-4599-a55e-91b2a049aca6" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:46:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Lock "cinder-quobyte-2caa96e6-496f-4599-a55e-91b2a049aca6" acquired by "delete_volume" :: waited 0.038s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:46:27 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1b7872-27b2-44c9-a257-f9dead165939]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:46:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:27 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6 Jul 24 15:46:27 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:28 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6" returned: 0 in 0.999s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:28 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6 Jul 24 15:46:28 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:28 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2caa96e6-496f-4599-a55e-91b2a049aca6" returned: 0 in 0.595s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Lock "cinder-quobyte-2caa96e6-496f-4599-a55e-91b2a049aca6" released by "delete_volume" :: held 1.762s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:46:29 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Created reservations ['40b183fb-003b-4b97-a04b-9c57edbc8c5b'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:46:29 devstack cinder-volume[88350]: WARNING cinder.quota [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1267235983 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1267235983, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:46:29 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Created reservations ['e69a91f0-65ba-4803-9218-d10d0aa29cb7', 'de08487d-1ee1-427d-a2e1-f31b835ce125', 'cabc8ae6-b150-4dcd-804c-db83c9acdff0', '4268090d-f84b-4b77-976b-6cd18b6dc1f1'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:46:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:46:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:46:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:29 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-72c309b7-9563-47cc-92ab-8ea17f5871ca req-1810e8f7-b286-4834-920a-c572d71fe184 tempest-AttachVolumeTestJSON-255636830 None] Terminate volume connection completed successfully. Jul 24 15:46:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-72c309b7-9563-47cc-92ab-8ea17f5871ca req-1810e8f7-b286-4834-920a-c572d71fe184 tempest-AttachVolumeTestJSON-255636830 None] Deleting attachment 92f9e4b0-ac16-4b21-9f3f-348df909a67b. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:46:29 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:46:29 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:30 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.763s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:30 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:46:30 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-30224f62-0100-4b0a-9f37-f8706daf3b5a tempest-GroupSnapshotsV319Test-1706142089 None] Delete group completed successfully. Jul 24 15:46:39 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=76,cinder:INSERT=19,cinder:UPDATE=80,cinder:DELETE=5 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:46:39 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=77,cinder:UPDATE=88,cinder:DELETE=7,cinder:INSERT=18 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:46:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:46:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:46:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:46:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:40 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:46:40 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:40 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.828s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:46:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:46:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 8 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:46:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Flow 'volume_create_manager' (aa95df94-d717-45f0-9f87-39c50623f193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29a0dd5-04ba-49a2-97c4-429e61043286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29a0dd5-04ba-49a2-97c4-429e61043286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-639661752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532b7de0-c0c4-47a0-b263-5030f9a6cfd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbadb6324a443458a0454ff3136cdf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:46:57Z,use_quota=True,user_id='0d72f25aa01c469eaa3796ddab6c2255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0ebdeb-0ab8-4d10-a453-c7ff8c18545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb0ebdeb-0ab8-4d10-a453-c7ff8c18545b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5a1f3c-d0af-45e6-a1d0-fd57786c60c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c5a1f3c-d0af-45e6-a1d0-fd57786c60c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '532b7de0-c0c4-47a0-b263-5030f9a6cfd8', 'volume_name': 'volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba143807-be95-48f0-b2d6-7f8c343f4d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba143807-be95-48f0-b2d6-7f8c343f4d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1a4d3b-5c54-445d-92dd-5f0061a9b813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:57 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Volume 532b7de0-c0c4-47a0-b263-5030f9a6cfd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8', 'volume_size': 1} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:46:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-639661752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=532b7de0-c0c4-47a0-b263-5030f9a6cfd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbadb6324a443458a0454ff3136cdf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:46:57Z,use_quota=True,user_id='0d72f25aa01c469eaa3796ddab6c2255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Creating volume 532b7de0-c0c4-47a0-b263-5030f9a6cfd8 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:46:57 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:57 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8 1073741824 Jul 24 15:46:57 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:57 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8 1073741824" returned: 0 in 0.433s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:46:57 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8 Jul 24 15:46:57 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:46:57 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Jul 24 15:46:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8" returned: 0 in 0.285s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:46:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:46:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:46:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b1a4d3b-5c54-445d-92dd-5f0061a9b813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a79e0ef-992d-4609-aee6-cce3e1107352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:46:58 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Volume volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8 (532b7de0-c0c4-47a0-b263-5030f9a6cfd8): created successfully Jul 24 15:46:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a79e0ef-992d-4609-aee6-cce3e1107352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:46:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Flow 'volume_create_manager' (aa95df94-d717-45f0-9f87-39c50623f193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:46:58 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2c48f37c-4743-4f11-a17b-b0a5ea4fcc52 tempest-ServersNegativeTestJSON-212580134 None] Created volume successfully. Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Flow 'volume_create_manager' (d2022680-e2fe-43ca-b662-e19b8f5c535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37288eac-460a-4887-9abd-008582f36b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37288eac-460a-4887-9abd-008582f36b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-486979457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847e76a6-1057-46c7-9385-e4ca059743b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e882836dad764b86a0c05cb46faa77ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:00Z,use_quota=True,user_id='549cfe7e588447eb8c6a4196c8b29d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de47612-950b-4285-af73-ed492a5fe7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de47612-950b-4285-af73-ed492a5fe7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45db5542-55a7-486d-bbe3-2b669b91aa51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45db5542-55a7-486d-bbe3-2b669b91aa51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '847e76a6-1057-46c7-9385-e4ca059743b8', 'volume_name': 'volume-847e76a6-1057-46c7-9385-e4ca059743b8', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad0d1f8-ed1d-4d4d-b6e4-89fb29800918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad0d1f8-ed1d-4d4d-b6e4-89fb29800918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20385b2d-5940-44c3-8e9d-7f5aa0b3e6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:00 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Volume 847e76a6-1057-46c7-9385-e4ca059743b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-847e76a6-1057-46c7-9385-e4ca059743b8', 'volume_size': 1} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-486979457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=847e76a6-1057-46c7-9385-e4ca059743b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e882836dad764b86a0c05cb46faa77ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:00Z,use_quota=True,user_id='549cfe7e588447eb8c6a4196c8b29d61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Creating volume 847e76a6-1057-46c7-9385-e4ca059743b8 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:00 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-847e76a6-1057-46c7-9385-e4ca059743b8 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:00 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-847e76a6-1057-46c7-9385-e4ca059743b8 1073741824 Jul 24 15:47:00 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:00 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-847e76a6-1057-46c7-9385-e4ca059743b8 1073741824" returned: 0 in 0.653s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-847e76a6-1057-46c7-9385-e4ca059743b8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:00 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-847e76a6-1057-46c7-9385-e4ca059743b8 Jul 24 15:47:00 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:00 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Flow 'volume_create_manager' (02f0b6d9-30cb-44fe-b671-ecc53b8db531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fed89ac-6f3c-449a-9635-ba0f49ebf590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fed89ac-6f3c-449a-9635-ba0f49ebf590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2097953961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c06820a-65b4-45fb-b601-d45f35a3b428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbadb6324a443458a0454ff3136cdf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:01Z,use_quota=True,user_id='0d72f25aa01c469eaa3796ddab6c2255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3721e61c-b031-4808-9da8-77516761a917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3721e61c-b031-4808-9da8-77516761a917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf34006-a8b7-4672-aa9a-355f1bdf5967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf34006-a8b7-4672-aa9a-355f1bdf5967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c06820a-65b4-45fb-b601-d45f35a3b428', 'volume_name': 'volume-4c06820a-65b4-45fb-b601-d45f35a3b428', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf97cc9-8659-49d6-b703-21402c144b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abf97cc9-8659-49d6-b703-21402c144b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420b4fde-861e-42ee-ba5e-c5087a56f06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:01 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Volume 4c06820a-65b4-45fb-b601-d45f35a3b428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c06820a-65b4-45fb-b601-d45f35a3b428', 'volume_size': 1} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:01 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-847e76a6-1057-46c7-9385-e4ca059743b8" returned: 0 in 0.330s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.157s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2097953961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c06820a-65b4-45fb-b601-d45f35a3b428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3dbadb6324a443458a0454ff3136cdf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:01Z,use_quota=True,user_id='0d72f25aa01c469eaa3796ddab6c2255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Creating volume 4c06820a-65b4-45fb-b601-d45f35a3b428 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:01 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c06820a-65b4-45fb-b601-d45f35a3b428 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:01 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c06820a-65b4-45fb-b601-d45f35a3b428 1073741824 Jul 24 15:47:01 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20385b2d-5940-44c3-8e9d-7f5aa0b3e6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-847e76a6-1057-46c7-9385-e4ca059743b8', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada10bd5-e961-41ee-8659-b40fb12ab417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:01 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Volume volume-847e76a6-1057-46c7-9385-e4ca059743b8 (847e76a6-1057-46c7-9385-e4ca059743b8): created successfully Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada10bd5-e961-41ee-8659-b40fb12ab417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Flow 'volume_create_manager' (d2022680-e2fe-43ca-b662-e19b8f5c535d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:01 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f4a17cd2-e39e-499c-8896-29dbe8151591 tempest-VolumesServicesTestJSON-932574719 None] Created volume successfully. Jul 24 15:47:01 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c06820a-65b4-45fb-b601-d45f35a3b428 1073741824" returned: 0 in 0.505s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c06820a-65b4-45fb-b601-d45f35a3b428 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:01 devstack sudo[95169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c06820a-65b4-45fb-b601-d45f35a3b428 Jul 24 15:47:01 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:02 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c06820a-65b4-45fb-b601-d45f35a3b428" returned: 0 in 0.272s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:02 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (420b4fde-861e-42ee-ba5e-c5087a56f06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c06820a-65b4-45fb-b601-d45f35a3b428', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6a1136-e564-4e14-8ba4-3caadb12cd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:02 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Volume volume-4c06820a-65b4-45fb-b601-d45f35a3b428 (4c06820a-65b4-45fb-b601-d45f35a3b428): created successfully Jul 24 15:47:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6a1136-e564-4e14-8ba4-3caadb12cd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Flow 'volume_create_manager' (02f0b6d9-30cb-44fe-b671-ecc53b8db531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:02 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-78802937-b94c-4a77-8fc4-87f245e795e5 tempest-ServersNegativeTestJSON-212580134 None] Created volume successfully. Jul 24 15:47:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Acquiring lock "cinder-847e76a6-1057-46c7-9385-e4ca059743b8-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Lock "cinder-847e76a6-1057-46c7-9385-e4ca059743b8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Acquiring lock "cinder-quobyte-847e76a6-1057-46c7-9385-e4ca059743b8" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Lock "cinder-quobyte-847e76a6-1057-46c7-9385-e4ca059743b8" acquired by "delete_volume" :: waited 0.027s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:02 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[df678562-b447-48af-b226-b8697374b77a]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-847e76a6-1057-46c7-9385-e4ca059743b8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:02 devstack sudo[95172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-847e76a6-1057-46c7-9385-e4ca059743b8 Jul 24 15:47:02 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:02 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-847e76a6-1057-46c7-9385-e4ca059743b8" returned: 0 in 0.406s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-847e76a6-1057-46c7-9385-e4ca059743b8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:02 devstack sudo[95177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-847e76a6-1057-46c7-9385-e4ca059743b8 Jul 24 15:47:02 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:03 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-847e76a6-1057-46c7-9385-e4ca059743b8" returned: 0 in 0.300s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Lock "cinder-quobyte-847e76a6-1057-46c7-9385-e4ca059743b8" released by "delete_volume" :: held 0.749s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Created reservations ['0e055827-4baf-4004-a4b1-f9000ee55771', '7e203918-5093-4200-997f-4afba98701c8', '0f6a0c22-8d03-4b4b-9045-6872fc859d1e', '8c9c5761-851d-46f8-a629-2d75c379dba8'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:03 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:47:03 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:03 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.294s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:03 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Deleted volume successfully. Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a82370ed-14b2-4e96-b3b9-a3a3f3da1817 tempest-VolumesServicesTestJSON-932574719 None] Lock "cinder-847e76a6-1057-46c7-9385-e4ca059743b8-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Acquiring lock "cinder-4c06820a-65b4-45fb-b601-d45f35a3b428-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Lock "cinder-4c06820a-65b4-45fb-b601-d45f35a3b428-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Acquiring lock "cinder-quobyte-4c06820a-65b4-45fb-b601-d45f35a3b428" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Lock "cinder-quobyte-4c06820a-65b4-45fb-b601-d45f35a3b428" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db248fb-5000-4f7f-87bd-f786df1d739c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c06820a-65b4-45fb-b601-d45f35a3b428 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:03 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c06820a-65b4-45fb-b601-d45f35a3b428 Jul 24 15:47:03 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:04 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c06820a-65b4-45fb-b601-d45f35a3b428" returned: 0 in 0.391s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c06820a-65b4-45fb-b601-d45f35a3b428 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:04 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c06820a-65b4-45fb-b601-d45f35a3b428 Jul 24 15:47:04 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:04 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c06820a-65b4-45fb-b601-d45f35a3b428" returned: 0 in 0.310s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Lock "cinder-quobyte-4c06820a-65b4-45fb-b601-d45f35a3b428" released by "delete_volume" :: held 0.755s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:04 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Created reservations ['6054c7a9-f26e-47c7-a39d-8a281dda9551', '3ee9222c-ae9a-4489-8c45-39946c16d0ae', '11670460-e3e7-4fb3-9baf-be56e1f38b1a', '8e97150a-4d83-45ae-9491-f79b001d2cff'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:04 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:47:04 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Acquiring lock "cinder-532b7de0-c0c4-47a0-b263-5030f9a6cfd8-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Lock "cinder-532b7de0-c0c4-47a0-b263-5030f9a6cfd8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Acquiring lock "cinder-quobyte-532b7de0-c0c4-47a0-b263-5030f9a6cfd8" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Lock "cinder-quobyte-532b7de0-c0c4-47a0-b263-5030f9a6cfd8" acquired by "delete_volume" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:05 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.402s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:05 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:05 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Deleted volume successfully. Jul 24 15:47:05 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6244e1-d951-4243-9261-be52c8cb37ec]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5ecf9a71-b754-42e1-a0e2-41c4e2fab30c tempest-ServersNegativeTestJSON-212580134 None] Lock "cinder-4c06820a-65b4-45fb-b601-d45f35a3b428-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:05 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8 Jul 24 15:47:05 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:05 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8" returned: 0 in 0.639s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:05 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8 Jul 24 15:47:05 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:06 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-532b7de0-c0c4-47a0-b263-5030f9a6cfd8" returned: 0 in 0.354s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Lock "cinder-quobyte-532b7de0-c0c4-47a0-b263-5030f9a6cfd8" released by "delete_volume" :: held 1.086s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:06 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Created reservations ['5112db3a-cdcb-42fe-a0a3-b01a0cc6695b', '7a26ce8d-6629-4a20-b4d6-e99682d6d5bc', 'f4ce45b1-bca8-4bba-822c-25830de8f20e', 'b3dd1141-baf8-4132-9b32-23e851b494c0'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:06 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:47:06 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:06 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.305s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:06 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:06 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Deleted volume successfully. Jul 24 15:47:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3b7905ba-30e7-4e90-b76e-1b5646ce37a0 tempest-ServersNegativeTestJSON-212580134 None] Lock "cinder-532b7de0-c0c4-47a0-b263-5030f9a6cfd8-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:11 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-b835027c-41d6-4545-b6e3-ecbc59839817 req-750de410-967e-4338-b7db-400d180934c7 tempest-AttachVolumeNegativeTest-1803157486 None] Terminate volume connection completed successfully. Jul 24 15:47:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-b835027c-41d6-4545-b6e3-ecbc59839817 req-750de410-967e-4338-b7db-400d180934c7 tempest-AttachVolumeNegativeTest-1803157486 None] Deleting attachment 242c79d8-74d0-4301-98e4-16e1feaaf23e. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:47:16 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=23,cinder:UPDATE=38,cinder:INSERT=8,cinder:DELETE=1 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:47:20 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f42a907b-37df-4428-9e90-52d2ad92cea8 tempest-GroupsTest-1312545738 None] Group tempest-Group1-667505056: creating Jul 24 15:47:20 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Flow 'volume_create_manager' (e6fe99e3-0a72-4cbf-b6b1-46bcf04b647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb69a00-bff3-4376-a9b9-7bbc61688420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:20 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f42a907b-37df-4428-9e90-52d2ad92cea8 tempest-GroupsTest-1312545738 None] Group tempest-Group1-667505056: created successfully Jul 24 15:47:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb69a00-bff3-4376-a9b9-7bbc61688420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-218000617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1af33d-04a0-4c5e-9951-c31b1c3c97db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e582e55337c4091887edeef142b2ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:21Z,use_quota=True,user_id='1674238243f74700905c02dbcff51dd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5b355b-3e84-4ecd-8a59-d8a040daa7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5b355b-3e84-4ecd-8a59-d8a040daa7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650be736-46ac-49be-90a2-d9472e7728fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:20 devstack cinder-volume[88350]: DEBUG cinder.image.glance [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Creating Keystone auth plugin from conf {{(pid=88350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:47:20 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f42a907b-37df-4428-9e90-52d2ad92cea8 tempest-GroupsTest-1312545738 None] Create group completed successfully. Jul 24 15:47:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650be736-46ac-49be-90a2-d9472e7728fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'af1af33d-04a0-4c5e-9951-c31b1c3c97db', 'volume_name': 'volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db', 'volume_size': 1, 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'df66204cc96f42be98c9c3c0564f8276', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'created_at': datetime.datetime(2026, 7, 24, 13, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba443635-de4d-41b0-81a9-5b39ef472dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba443635-de4d-41b0-81a9-5b39ef472dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd333ba-d418-49ee-a070-2813bc849fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:21 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Volume af1af33d-04a0-4c5e-9951-c31b1c3c97db: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db', 'volume_size': 1, 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'df66204cc96f42be98c9c3c0564f8276', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'created_at': datetime.datetime(2026, 7, 24, 13, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 15:47:21 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Trying to clone af1af33d-04a0-4c5e-9951-c31b1c3c97db from image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]). {{(pid=88350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:47:21 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_cv09ih_pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:47:21 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Image download 20.69 MB at 20.69 MB/s Jul 24 15:47:21 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbada52d-2778-41c5-9b29-5377ce130a19]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_cv09ih_pdevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:21 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_cv09ih_pdevstack@QuobyteHD Jul 24 15:47:21 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:22 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-fecbc9a8-2e1a-41bd-a933-1fa21334b862 tempest-GroupsTest-1312545738 None] Group tempest-Group2-540213887: creating Jul 24 15:47:22 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-fecbc9a8-2e1a-41bd-a933-1fa21334b862 tempest-GroupsTest-1312545738 None] Group tempest-Group2-540213887: created successfully Jul 24 15:47:22 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-fecbc9a8-2e1a-41bd-a933-1fa21334b862 tempest-GroupsTest-1312545738 None] Create group completed successfully. Jul 24 15:47:22 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_cv09ih_pdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Temporary image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 is fetched for user 1674238243f74700905c02dbcff51dd6. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[959ab57c-1895-4f7b-bed2-6b2b9c0381e9]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_cv09ih_pdevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:22 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_cv09ih_pdevstack@QuobyteHD Jul 24 15:47:22 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:22 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_cv09ih_pdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-218000617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af1af33d-04a0-4c5e-9951-c31b1c3c97db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e582e55337c4091887edeef142b2ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:21Z,use_quota=True,user_id='1674238243f74700905c02dbcff51dd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Creating volume af1af33d-04a0-4c5e-9951-c31b1c3c97db {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:22 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:47:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:22 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db 1073741824 Jul 24 15:47:22 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:23 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db 1073741824" returned: 0 in 0.638s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:23 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db Jul 24 15:47:23 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:24 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db" returned: 0 in 0.646s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Attempting download of 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}])) to volume af1af33d-04a0-4c5e-9951-c31b1c3c97db. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Flow 'volume_create_manager' (40fd5387-43ae-4235-a24f-91dd1ba814fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db22affa-7dd7-461e-a0ca-cfa75caf2107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db22affa-7dd7-461e-a0ca-cfa75caf2107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-900865001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d48df1e0-4867-4d04-baae-568ebb730f43,host='devstack@QuobyteHD#QuobyteHD',id=4cda4ef9-d509-4ae1-a80e-679ff1289360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1138d4532c774bac84159473f5d49282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:24Z,use_quota=True,user_id='651b9180e1dd4e468ca181e14fb3a261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(884619b7-0f12-487c-8213-82ca4dc7a891),volume_type_id=884619b7-0f12-487c-8213-82ca4dc7a891)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fca555-1377-4266-b755-69f183752182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fca555-1377-4266-b755-69f183752182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289700c6-7531-4fe7-a3be-d772bab913d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289700c6-7531-4fe7-a3be-d772bab913d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cda4ef9-d509-4ae1-a80e-679ff1289360', 'volume_name': 'volume-4cda4ef9-d509-4ae1-a80e-679ff1289360', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf246f7a-c40a-441c-b2bf-10511d5efd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf246f7a-c40a-441c-b2bf-10511d5efd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3ef3b6-47d3-4772-9655-ab7a666a9bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:24 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Volume 4cda4ef9-d509-4ae1-a80e-679ff1289360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cda4ef9-d509-4ae1-a80e-679ff1289360', 'volume_size': 1} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d48df1e0-4867-4d04-baae-568ebb730f43,created_at=2026-07-24T13:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-900865001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d48df1e0-4867-4d04-baae-568ebb730f43,host='devstack@QuobyteHD#QuobyteHD',id=4cda4ef9-d509-4ae1-a80e-679ff1289360,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1138d4532c774bac84159473f5d49282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:24Z,use_quota=True,user_id='651b9180e1dd4e468ca181e14fb3a261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(884619b7-0f12-487c-8213-82ca4dc7a891),volume_type_id=884619b7-0f12-487c-8213-82ca4dc7a891)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Creating volume 4cda4ef9-d509-4ae1-a80e-679ff1289360 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:24 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4cda4ef9-d509-4ae1-a80e-679ff1289360 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28d0169-e1c0-4b27-b18d-eeba3d4d35ea]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_3zlk1jl8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:24 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4cda4ef9-d509-4ae1-a80e-679ff1289360 1073741824 Jul 24 15:47:24 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:24 devstack sudo[95409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_3zlk1jl8 Jul 24 15:47:24 devstack sudo[95409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:24 devstack sudo[95409]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_3zlk1jl8" returned: 0 in 0.489s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_3zlk1jl8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:25 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_3zlk1jl8 Jul 24 15:47:25 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:25 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4cda4ef9-d509-4ae1-a80e-679ff1289360 1073741824" returned: 0 in 0.718s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4cda4ef9-d509-4ae1-a80e-679ff1289360 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:25 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4cda4ef9-d509-4ae1-a80e-679ff1289360 Jul 24 15:47:25 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:25 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_3zlk1jl8" returned: 1 in 0.471s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_3zlk1jl8' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b247742-d1b7-43a0-858e-8bd5cd8c11ae]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_cv09ih_pdevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:25 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_cv09ih_pdevstack@QuobyteHD Jul 24 15:47:25 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:25 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4cda4ef9-d509-4ae1-a80e-679ff1289360" returned: 0 in 0.441s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3ef3b6-47d3-4772-9655-ab7a666a9bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cda4ef9-d509-4ae1-a80e-679ff1289360', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1115a7-4a1f-4d2f-a701-b9913b6b4aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:25 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Volume volume-4cda4ef9-d509-4ae1-a80e-679ff1289360 (4cda4ef9-d509-4ae1-a80e-679ff1289360): created successfully Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d1115a7-4a1f-4d2f-a701-b9913b6b4aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Flow 'volume_create_manager' (40fd5387-43ae-4235-a24f-91dd1ba814fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:25 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-be60f3a8-39d2-4502-94a4-4b2fdb244bc6 tempest-GroupsTest-1312545738 None] Created volume successfully. Jul 24 15:47:25 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_cv09ih_pdevstack@QuobyteHD" returned: 0 in 0.519s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 was qcow2, converting to qcow2 {{(pid=88350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:47:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_cv09ih_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:26 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_cv09ih_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db Jul 24 15:47:26 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Acquiring lock "cinder-quobyte-4cda4ef9-d509-4ae1-a80e-679ff1289360" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Lock "cinder-quobyte-4cda4ef9-d509-4ae1-a80e-679ff1289360" acquired by "delete_volume" :: waited 0.063s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:27 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcaf16b-7570-4459-b477-c0f5b71f0dff]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4cda4ef9-d509-4ae1-a80e-679ff1289360 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:27 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4cda4ef9-d509-4ae1-a80e-679ff1289360 Jul 24 15:47:27 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:28 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4cda4ef9-d509-4ae1-a80e-679ff1289360" returned: 0 in 0.616s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4cda4ef9-d509-4ae1-a80e-679ff1289360 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:28 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4cda4ef9-d509-4ae1-a80e-679ff1289360 Jul 24 15:47:28 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:28 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4cda4ef9-d509-4ae1-a80e-679ff1289360" returned: 0 in 0.475s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Lock "cinder-quobyte-4cda4ef9-d509-4ae1-a80e-679ff1289360" released by "delete_volume" :: held 1.215s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:28 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Created reservations ['33461132-37e9-4e92-b6d9-4eb495c88358'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:29 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_cv09ih_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db" returned: 0 in 3.028s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_cv09ih_pdevstack@QuobyteHD, size 112.00 MB, duration 3.03 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:47:29 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Converted 112.00 MB image at 36.97 MB/s Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:29 devstack cinder-volume[88350]: WARNING cinder.quota [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1012295831 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1012295831, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:47:29 devstack cinder-volume[88350]: WARNING cinder.quota [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1012295831 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1012295831, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:47:29 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db 1G Jul 24 15:47:29 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Created reservations ['e7d0b7c9-1a4e-4055-b24d-44eb4a167b36', '0b479235-d762-48bd-bc39-924225984a43', 'b2825b45-5630-47c0-9d6f-e98ad4c8382c', 'bbdff671-f1c2-4ba9-935f-dabd978625c7'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:29 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:47:29 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:29 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db 1G" returned: 0 in 0.676s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Downloaded image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}])) to volume af1af33d-04a0-4c5e-9951-c31b1c3c97db successfully. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Temporary image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 for user 1674238243f74700905c02dbcff51dd6 is deleted. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Marking volume af1af33d-04a0-4c5e-9951-c31b1c3c97db as bootable. {{(pid=88350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Copying metadata from image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 to af1af33d-04a0-4c5e-9951-c31b1c3c97db. {{(pid=88350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Creating volume glance metadata for volume af1af33d-04a0-4c5e-9951-c31b1c3c97db backed by image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dd333ba-d418-49ee-a070-2813bc849fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db', 'volume_size': 1, 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'df66204cc96f42be98c9c3c0564f8276', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'created_at': datetime.datetime(2026, 7, 24, 13, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0038f7-3abb-481a-8273-262c63e690d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:29 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Volume volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db (af1af33d-04a0-4c5e-9951-c31b1c3c97db): created successfully Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0038f7-3abb-481a-8273-262c63e690d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Flow 'volume_create_manager' (e6fe99e3-0a72-4cbf-b6b1-46bcf04b647d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:29 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7c0ecacc-514b-4d42-9df4-616c23a2588f tempest-VolumesImageMetadata-1690632559 None] Created volume successfully. Jul 24 15:47:29 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.600s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:29 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:29 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-313a111c-f829-4c4e-83cd-a75026ed2c28 tempest-GroupsTest-1312545738 None] Delete group completed successfully. Jul 24 15:47:30 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-6569c89c-0b7b-4a46-b62c-33ea9d484f43 tempest-GroupsTest-1312545738 None] Created reservations ['03866acd-f49f-4e82-9d9d-2117ff493998'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6569c89c-0b7b-4a46-b62c-33ea9d484f43 tempest-GroupsTest-1312545738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6569c89c-0b7b-4a46-b62c-33ea9d484f43 tempest-GroupsTest-1312545738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6569c89c-0b7b-4a46-b62c-33ea9d484f43 tempest-GroupsTest-1312545738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6569c89c-0b7b-4a46-b62c-33ea9d484f43 tempest-GroupsTest-1312545738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6569c89c-0b7b-4a46-b62c-33ea9d484f43 tempest-GroupsTest-1312545738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6569c89c-0b7b-4a46-b62c-33ea9d484f43 tempest-GroupsTest-1312545738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:30 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:47:30 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:31 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6569c89c-0b7b-4a46-b62c-33ea9d484f43 tempest-GroupsTest-1312545738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.612s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:31 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-6569c89c-0b7b-4a46-b62c-33ea9d484f43 tempest-GroupsTest-1312545738 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:31 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-6569c89c-0b7b-4a46-b62c-33ea9d484f43 tempest-GroupsTest-1312545738 None] Delete group completed successfully. Jul 24 15:47:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Acquiring lock "cinder-af1af33d-04a0-4c5e-9951-c31b1c3c97db-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Lock "cinder-af1af33d-04a0-4c5e-9951-c31b1c3c97db-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Acquiring lock "cinder-quobyte-af1af33d-04a0-4c5e-9951-c31b1c3c97db" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Lock "cinder-quobyte-af1af33d-04a0-4c5e-9951-c31b1c3c97db" acquired by "delete_volume" :: waited 0.038s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:31 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[059063c7-2d0a-444c-a64e-5a17a5a93399]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:31 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db Jul 24 15:47:31 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:32 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db" returned: 0 in 0.600s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:32 devstack sudo[95561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db Jul 24 15:47:32 devstack sudo[95561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:32 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d36a3b9a-04bd-422f-97ff-84b4b9cb15c1 tempest-GroupsTest-1312545738 None] Group tempest-GroupsTest-Group-2071390755: creating Jul 24 15:47:32 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d36a3b9a-04bd-422f-97ff-84b4b9cb15c1 tempest-GroupsTest-1312545738 None] Group tempest-GroupsTest-Group-2071390755: created successfully Jul 24 15:47:32 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d36a3b9a-04bd-422f-97ff-84b4b9cb15c1 tempest-GroupsTest-1312545738 None] Create group completed successfully. Jul 24 15:47:32 devstack sudo[95561]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-af1af33d-04a0-4c5e-9951-c31b1c3c97db" returned: 0 in 0.379s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Lock "cinder-quobyte-af1af33d-04a0-4c5e-9951-c31b1c3c97db" released by "delete_volume" :: held 1.068s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:32 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Created reservations ['8a3175f6-0db2-4a66-9be4-7ac9ca6ab6f7', 'c38fb7e1-4aac-41fb-9a6c-82e32c5818b1', 'e5d39b80-c810-41b6-a497-88c78a769185', '1ba67903-acb0-49e3-918c-7a1f6b7dd18a'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:33 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:47:33 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:33 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.350s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:33 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:33 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Deleted volume successfully. Jul 24 15:47:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f7211719-b59d-402f-b7ad-95de7a92e382 tempest-VolumesImageMetadata-1690632559 None] Lock "cinder-af1af33d-04a0-4c5e-9951-c31b1c3c97db-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Flow 'volume_create_manager' (0b8b2af7-7579-47a2-91d1-f39f57ed84c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eefa63d-125d-4bdc-97f1-6f2cfc4984ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eefa63d-125d-4bdc-97f1-6f2cfc4984ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-504513261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b5661403-e154-4578-91c5-64c219335266,host='devstack@QuobyteHD#QuobyteHD',id=f0dc9c21-d232-437f-ad6f-3f8385022b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1138d4532c774bac84159473f5d49282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:35Z,use_quota=True,user_id='651b9180e1dd4e468ca181e14fb3a261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae0a9c65-3ee5-487a-9245-e93be76e81c8),volume_type_id=ae0a9c65-3ee5-487a-9245-e93be76e81c8)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0532de1-f2b2-41b7-bf2f-ffeca1ba51e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0532de1-f2b2-41b7-bf2f-ffeca1ba51e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd96c61a-b381-47ce-a132-7684a20f125e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd96c61a-b381-47ce-a132-7684a20f125e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0dc9c21-d232-437f-ad6f-3f8385022b13', 'volume_name': 'volume-f0dc9c21-d232-437f-ad6f-3f8385022b13', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18eafb95-fc3d-409b-91e0-0a5121ea3bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18eafb95-fc3d-409b-91e0-0a5121ea3bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf8e2a9-2e37-4344-8826-0e6200a23aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:34 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Volume f0dc9c21-d232-437f-ad6f-3f8385022b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0dc9c21-d232-437f-ad6f-3f8385022b13', 'volume_size': 1} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b5661403-e154-4578-91c5-64c219335266,created_at=2026-07-24T13:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-504513261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b5661403-e154-4578-91c5-64c219335266,host='devstack@QuobyteHD#QuobyteHD',id=f0dc9c21-d232-437f-ad6f-3f8385022b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1138d4532c774bac84159473f5d49282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:35Z,use_quota=True,user_id='651b9180e1dd4e468ca181e14fb3a261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae0a9c65-3ee5-487a-9245-e93be76e81c8),volume_type_id=ae0a9c65-3ee5-487a-9245-e93be76e81c8)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Creating volume f0dc9c21-d232-437f-ad6f-3f8385022b13 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:34 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:47:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f0dc9c21-d232-437f-ad6f-3f8385022b13 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:35 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f0dc9c21-d232-437f-ad6f-3f8385022b13 1073741824 Jul 24 15:47:35 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:35 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f0dc9c21-d232-437f-ad6f-3f8385022b13 1073741824" returned: 0 in 0.856s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f0dc9c21-d232-437f-ad6f-3f8385022b13 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:36 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f0dc9c21-d232-437f-ad6f-3f8385022b13 Jul 24 15:47:36 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:36 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f0dc9c21-d232-437f-ad6f-3f8385022b13" returned: 0 in 0.500s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:36 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf8e2a9-2e37-4344-8826-0e6200a23aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0dc9c21-d232-437f-ad6f-3f8385022b13', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972f4316-ea03-4c8c-b0a9-bebd01bba443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:36 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Volume volume-f0dc9c21-d232-437f-ad6f-3f8385022b13 (f0dc9c21-d232-437f-ad6f-3f8385022b13): created successfully Jul 24 15:47:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972f4316-ea03-4c8c-b0a9-bebd01bba443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Flow 'volume_create_manager' (0b8b2af7-7579-47a2-91d1-f39f57ed84c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:36 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-90a9d5b0-6f3e-4ce4-8885-4df0604b55c6 tempest-GroupsTest-1312545738 None] Created volume successfully. Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Flow 'volume_create_manager' (77d9e130-c677-4fe3-844e-79525eb5a4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d04fa5-7d7d-4ca2-9141-6e4eaa343405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d04fa5-7d7d-4ca2-9141-6e4eaa343405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-103982570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b5661403-e154-4578-91c5-64c219335266,host='devstack@QuobyteHD#QuobyteHD',id=0a6af884-7f91-47eb-a57e-22bfb0a5d272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1138d4532c774bac84159473f5d49282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:39Z,use_quota=True,user_id='651b9180e1dd4e468ca181e14fb3a261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae0a9c65-3ee5-487a-9245-e93be76e81c8),volume_type_id=ae0a9c65-3ee5-487a-9245-e93be76e81c8)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb655a9-41bb-47af-924f-1596b8df1157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb655a9-41bb-47af-924f-1596b8df1157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096f4c8b-a343-4cb2-bb91-d2960b68d568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096f4c8b-a343-4cb2-bb91-d2960b68d568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6af884-7f91-47eb-a57e-22bfb0a5d272', 'volume_name': 'volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff73cf3-2eb1-4959-abd5-ca2ec71344e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff73cf3-2eb1-4959-abd5-ca2ec71344e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2926b4a3-d76b-4a5f-93f5-ae12a281b196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:38 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Volume 0a6af884-7f91-47eb-a57e-22bfb0a5d272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272', 'volume_size': 1} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b5661403-e154-4578-91c5-64c219335266,created_at=2026-07-24T13:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-103982570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b5661403-e154-4578-91c5-64c219335266,host='devstack@QuobyteHD#QuobyteHD',id=0a6af884-7f91-47eb-a57e-22bfb0a5d272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1138d4532c774bac84159473f5d49282',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:39Z,use_quota=True,user_id='651b9180e1dd4e468ca181e14fb3a261',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ae0a9c65-3ee5-487a-9245-e93be76e81c8),volume_type_id=ae0a9c65-3ee5-487a-9245-e93be76e81c8)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Creating volume 0a6af884-7f91-47eb-a57e-22bfb0a5d272 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:38 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:47:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:38 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272 1073741824 Jul 24 15:47:38 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:39 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272 1073741824" returned: 0 in 0.705s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:39 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272 Jul 24 15:47:39 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Flow 'volume_create_manager' (b951830d-5345-4760-8a3a-a8d06c7acd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ba781c-1cdd-4819-a7de-842ed2429289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ba781c-1cdd-4819-a7de-842ed2429289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1600108719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c639e138-ab9f-43bf-90f2-11a35c7c3d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb157a9793cc4ab689dfc4fc5a95a589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:40Z,use_quota=True,user_id='fc531a09272240df88691528d00cd352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94920482-3416-4365-bd46-466da8669368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94920482-3416-4365-bd46-466da8669368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d210070-791f-43ee-b3bc-75d7a7ea53dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d210070-791f-43ee-b3bc-75d7a7ea53dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c639e138-ab9f-43bf-90f2-11a35c7c3d6e', 'volume_name': 'volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be99c6e-f8fb-43ca-9d67-f07e5aa441bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be99c6e-f8fb-43ca-9d67-f07e5aa441bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aec1615-f55b-41a8-bb26-1c4753f3770e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:39 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Volume c639e138-ab9f-43bf-90f2-11a35c7c3d6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e', 'volume_size': 1} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:40 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272" returned: 0 in 0.370s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.209s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1600108719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c639e138-ab9f-43bf-90f2-11a35c7c3d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb157a9793cc4ab689dfc4fc5a95a589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:40Z,use_quota=True,user_id='fc531a09272240df88691528d00cd352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Creating volume c639e138-ab9f-43bf-90f2-11a35c7c3d6e {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:40 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:47:40 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:40 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2926b4a3-d76b-4a5f-93f5-ae12a281b196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c66dc4d-3ef5-4b8d-a25c-1662c2728c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:40 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Volume volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272 (0a6af884-7f91-47eb-a57e-22bfb0a5d272): created successfully Jul 24 15:47:40 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e 1073741824 Jul 24 15:47:40 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c66dc4d-3ef5-4b8d-a25c-1662c2728c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Flow 'volume_create_manager' (77d9e130-c677-4fe3-844e-79525eb5a4c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:40 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3829dc9c-0778-4060-be70-7871545d6528 tempest-GroupsTest-1312545738 None] Created volume successfully. Jul 24 15:47:40 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.476s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:47:40 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e 1073741824" returned: 0 in 0.697s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:40 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e Jul 24 15:47:40 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:41 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e" returned: 0 in 0.621s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aec1615-f55b-41a8-bb26-1c4753f3770e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5c3225-7443-4d22-8ccd-36ed987581f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:41 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Volume volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e (c639e138-ab9f-43bf-90f2-11a35c7c3d6e): created successfully Jul 24 15:47:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5c3225-7443-4d22-8ccd-36ed987581f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Flow 'volume_create_manager' (b951830d-5345-4760-8a3a-a8d06c7acd39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:41 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f53c0434-41a0-4034-8ddd-d30ab81a4eea tempest-SnapshotMetadataTestJSON-1942778872 None] Created volume successfully. Jul 24 15:47:42 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c804607b-9650-4dc6-9110-515ee9fa4b53 tempest-GroupsTest-1312545738 None] Update group completed successfully. Jul 24 15:47:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] Creating offline snapshot 15a2dd8c-80dd-4905-916d-edbacda4a20e of volume c639e138-ab9f-43bf-90f2-11a35c7c3d6e {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:47:42 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceed309-4a93-4a03-9314-6d49636d0cad]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:42 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e Jul 24 15:47:42 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:43 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e" returned: 0 in 0.445s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:43 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e 1G Jul 24 15:47:43 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:43 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-79aa9235-2b4d-4751-a32e-b67a52690bfa tempest-GroupsTest-1312545738 None] Update group completed successfully. Jul 24 15:47:43 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e 1G" returned: 0 in 0.587s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:43 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e Jul 24 15:47:43 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:44 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e" returned: 0 in 0.364s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:44 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e is being set with open permissions: ugo+rw Jul 24 15:47:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:44 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e Jul 24 15:47:44 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:44 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e" returned: 0 in 0.380s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:44 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.info Jul 24 15:47:44 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:44 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.info" returned: 0 in 0.473s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:44 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.info is being set with open permissions: ugo+rw Jul 24 15:47:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:44 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.info Jul 24 15:47:44 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:45 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.info" returned: 0 in 0.376s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.781s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:45 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c6a156fb-b6e5-473f-b636-6d7f26b29c4b tempest-SnapshotMetadataTestJSON-1942778872 None] Create snapshot completed successfully Jul 24 15:47:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Acquiring lock "cinder-quobyte-0a6af884-7f91-47eb-a57e-22bfb0a5d272" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Lock "cinder-quobyte-0a6af884-7f91-47eb-a57e-22bfb0a5d272" acquired by "delete_volume" :: waited 0.029s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:45 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03249c5-b5fb-4d1c-9077-33248efa7a65]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:45 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272 Jul 24 15:47:45 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:46 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272" returned: 0 in 0.571s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:46 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272 Jul 24 15:47:46 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:46 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0a6af884-7f91-47eb-a57e-22bfb0a5d272" returned: 0 in 0.379s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Lock "cinder-quobyte-0a6af884-7f91-47eb-a57e-22bfb0a5d272" released by "delete_volume" :: held 1.009s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Acquiring lock "cinder-quobyte-f0dc9c21-d232-437f-ad6f-3f8385022b13" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Lock "cinder-quobyte-f0dc9c21-d232-437f-ad6f-3f8385022b13" acquired by "delete_volume" :: waited 0.045s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:46 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[594ad2bd-4cdf-4881-9c58-407b508e1d75]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f0dc9c21-d232-437f-ad6f-3f8385022b13 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:46 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f0dc9c21-d232-437f-ad6f-3f8385022b13 Jul 24 15:47:46 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Acquiring lock "cinder-15a2dd8c-80dd-4905-916d-edbacda4a20e-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "cinder-15a2dd8c-80dd-4905-916d-edbacda4a20e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.084s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Acquiring lock "cinder-quobyte-c639e138-ab9f-43bf-90f2-11a35c7c3d6e" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "cinder-quobyte-c639e138-ab9f-43bf-90f2-11a35c7c3d6e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Acquiring lock "cinder-quobyte-15a2dd8c-80dd-4905-916d-edbacda4a20e" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "cinder-quobyte-15a2dd8c-80dd-4905-916d-edbacda4a20e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Deleting offline snapshot 15a2dd8c-80dd-4905-916d-edbacda4a20e of volume c639e138-ab9f-43bf-90f2-11a35c7c3d6e {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] snapshot_file for this snap is: volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[868f7247-0ada-4115-b4c7-131ae0ef8d63]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:47 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f0dc9c21-d232-437f-ad6f-3f8385022b13" returned: 0 in 0.637s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f0dc9c21-d232-437f-ad6f-3f8385022b13 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:47 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e Jul 24 15:47:47 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:47 devstack sudo[95766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f0dc9c21-d232-437f-ad6f-3f8385022b13 Jul 24 15:47:47 devstack sudo[95766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:47 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e" returned: 0 in 0.417s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:47 devstack sudo[95766]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f0dc9c21-d232-437f-ad6f-3f8385022b13" returned: 0 in 0.344s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc4ef9b-89d7-4bc9-9824-86617f06bb46]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Lock "cinder-quobyte-f0dc9c21-d232-437f-ad6f-3f8385022b13" released by "delete_volume" :: held 1.054s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Created reservations ['8ff8b958-761f-4749-8873-dadd932272a0'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:47 devstack cinder-volume[88350]: WARNING cinder.quota [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1707325680 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1707325680, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:47:47 devstack cinder-volume[88350]: WARNING cinder.quota [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1707325680 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1707325680, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Created reservations ['0edda7b1-fbc3-431a-9c8b-6ffdd347aa8d', 'c8e9cf2e-2aca-4f44-8080-92d3d76da438', '2d7b9fc5-9b56-45cc-97ab-06a65dc9bafa', '4f8824cc-ad48-44f4-add0-82743ca4640c'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:47 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e Jul 24 15:47:47 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:47 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Created reservations ['a2aef035-0654-4a1d-9032-b76e0369626d', 'dc130d9a-a3ba-46b9-8a56-98745aa8b100', '078b5e31-8a32-4a4d-b371-d96c4ae52aa1', 'f71b60bd-9102-4fa0-a8ac-cc4a1630eafb'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:48 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:47:48 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:48 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e" returned: 0 in 0.438s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:48 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e Jul 24 15:47:48 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:48 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.298s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:48 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:48 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-686297c0-3140-45d9-be29-c7fb17f65adb tempest-GroupsTest-1312545738 None] Delete group completed successfully. Jul 24 15:47:48 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e" returned: 0 in 0.460s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:48 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e Jul 24 15:47:48 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:48 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e.15a2dd8c-80dd-4905-916d-edbacda4a20e" returned: 0 in 0.338s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:48 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "cinder-quobyte-15a2dd8c-80dd-4905-916d-edbacda4a20e" released by "_delete_snapshot" :: held 1.798s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:48 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "cinder-quobyte-c639e138-ab9f-43bf-90f2-11a35c7c3d6e" released by "delete_snapshot" :: held 1.831s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:49 devstack cinder-volume[88350]: WARNING cinder.quota [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:47:49 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Created reservations ['a120f25a-6163-496c-aea1-0fd03d84ef98', '229b6858-0ca6-4648-be4c-9b60ea825f75', 'd93a1351-3f0a-4b21-bc79-d8b7a16576f8', '69940a14-c58c-4471-911b-9b8de0033475'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:49 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Delete snapshot completed successfully. Jul 24 15:47:49 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71c4fb6e-720c-45ba-9eaa-eb25ed97a13d tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "cinder-15a2dd8c-80dd-4905-916d-edbacda4a20e-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:49 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Acquiring lock "cinder-c639e138-ab9f-43bf-90f2-11a35c7c3d6e-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:49 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "cinder-c639e138-ab9f-43bf-90f2-11a35c7c3d6e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:49 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Acquiring lock "cinder-quobyte-c639e138-ab9f-43bf-90f2-11a35c7c3d6e" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:47:49 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "cinder-quobyte-c639e138-ab9f-43bf-90f2-11a35c7c3d6e" acquired by "delete_volume" :: waited 0.034s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:47:49 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd66f10-74cb-43d0-a8d0-4227e824c258]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:47:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:49 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e Jul 24 15:47:49 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:50 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e" returned: 0 in 0.507s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:50 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e Jul 24 15:47:50 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:50 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c639e138-ab9f-43bf-90f2-11a35c7c3d6e" returned: 0 in 0.298s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:50 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "cinder-quobyte-c639e138-ab9f-43bf-90f2-11a35c7c3d6e" released by "delete_volume" :: held 0.896s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:50 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=92,cinder:UPDATE=94,cinder:DELETE=7,cinder:INSERT=35 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:47:50 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Created reservations ['cb18d915-0901-4866-b809-90872e829bdc', 'c03ded09-243e-4d24-b6ec-8f73e8b44927', '5c1dc76f-f715-47d0-b08a-c8709fe98feb', 'ff9622d8-a63d-4caa-9e60-f8f8517a35ae'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:50 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:47:50 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:51 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.457s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:51 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:51 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Deleted volume successfully. Jul 24 15:47:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-92a2bd4c-0745-4518-9905-1c1d1211cb25 tempest-SnapshotMetadataTestJSON-1942778872 None] Lock "cinder-c639e138-ab9f-43bf-90f2-11a35c7c3d6e-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:47:55 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1072a0d9-04ad-405b-b001-1438c6315582 tempest-GroupsV320Test-639462530 None] Group tempest-GroupsV320Test-Group-1542945442: creating Jul 24 15:47:55 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1072a0d9-04ad-405b-b001-1438c6315582 tempest-GroupsV320Test-639462530 None] Group tempest-GroupsV320Test-Group-1542945442: created successfully Jul 24 15:47:55 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1072a0d9-04ad-405b-b001-1438c6315582 tempest-GroupsV320Test-639462530 None] Create group completed successfully. Jul 24 15:47:55 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Flow 'volume_create_manager' (e934c6e6-7945-43e9-9d2a-4ca4a00b6685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c43e84-5875-4629-ab44-c044a10774af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c43e84-5875-4629-ab44-c044a10774af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-507241974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f977f67a-fbe0-43ce-a3e3-7181f28194ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba17de3289db46469403f207bdd9877a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:56Z,use_quota=True,user_id='9bf314cec59347699e00152a45507da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc835c3-199d-491f-966b-4ea47eddc2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc835c3-199d-491f-966b-4ea47eddc2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a7d760-c099-4a82-9ffe-50487e6625e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a7d760-c099-4a82-9ffe-50487e6625e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f977f67a-fbe0-43ce-a3e3-7181f28194ae', 'volume_name': 'volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42291f22-f999-497d-92cc-ebcddbae9834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42291f22-f999-497d-92cc-ebcddbae9834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643835c9-7627-4fed-b631-e1d86971fbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:56 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Volume f977f67a-fbe0-43ce-a3e3-7181f28194ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae', 'volume_size': 1} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-507241974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f977f67a-fbe0-43ce-a3e3-7181f28194ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba17de3289db46469403f207bdd9877a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:56Z,use_quota=True,user_id='9bf314cec59347699e00152a45507da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Creating volume f977f67a-fbe0-43ce-a3e3-7181f28194ae {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:56 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:56 devstack sudo[95841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae 1073741824 Jul 24 15:47:56 devstack sudo[95841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:56 devstack sudo[95841]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae 1073741824" returned: 0 in 0.611s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:56 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae Jul 24 15:47:56 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:57 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae" returned: 0 in 0.312s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643835c9-7627-4fed-b631-e1d86971fbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7421677-c8c8-4a37-8d81-62970ff9d09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:57 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Volume volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae (f977f67a-fbe0-43ce-a3e3-7181f28194ae): created successfully Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7421677-c8c8-4a37-8d81-62970ff9d09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Flow 'volume_create_manager' (e934c6e6-7945-43e9-9d2a-4ca4a00b6685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:57 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-902a249c-f615-4a27-be57-392420ad5049 tempest-AttachVolumeNegativeTest-1803157486 None] Created volume successfully. Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-5254d547-9e48-4a8d-9a86-fa24246ef311 tempest-GroupsV320Test-639462530 None] Created reservations ['575e2f8d-481f-43d6-940d-bbab0a5a6baa'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5254d547-9e48-4a8d-9a86-fa24246ef311 tempest-GroupsV320Test-639462530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5254d547-9e48-4a8d-9a86-fa24246ef311 tempest-GroupsV320Test-639462530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5254d547-9e48-4a8d-9a86-fa24246ef311 tempest-GroupsV320Test-639462530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5254d547-9e48-4a8d-9a86-fa24246ef311 tempest-GroupsV320Test-639462530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5254d547-9e48-4a8d-9a86-fa24246ef311 tempest-GroupsV320Test-639462530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5254d547-9e48-4a8d-9a86-fa24246ef311 tempest-GroupsV320Test-639462530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:57 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:47:57 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:57 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5254d547-9e48-4a8d-9a86-fa24246ef311 tempest-GroupsV320Test-639462530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.241s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-5254d547-9e48-4a8d-9a86-fa24246ef311 tempest-GroupsV320Test-639462530 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:47:57 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-5254d547-9e48-4a8d-9a86-fa24246ef311 tempest-GroupsV320Test-639462530 None] Delete group completed successfully. Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Flow 'volume_create_manager' (05acfa5c-e439-4b03-8898-a60c15f2907a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900d4c8c-a730-4073-a215-69b6955133a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900d4c8c-a730-4073-a215-69b6955133a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-638705788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4487007e-785e-4b05-b8eb-f85296541eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f5453998a5494fae74517509c05797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:58Z,use_quota=True,user_id='89d9b34c2844448d896278524b81b224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef59b2e-63ae-4c5b-9ae9-334161fa86a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef59b2e-63ae-4c5b-9ae9-334161fa86a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1dabd9-48a6-4e82-bcab-d64717988d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1dabd9-48a6-4e82-bcab-d64717988d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4487007e-785e-4b05-b8eb-f85296541eb2', 'volume_name': 'volume-4487007e-785e-4b05-b8eb-f85296541eb2', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8845ba84-1337-43db-9df3-fc967f086b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8845ba84-1337-43db-9df3-fc967f086b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045e12cc-27a3-455f-9d73-ac719d1c53e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:57 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Volume 4487007e-785e-4b05-b8eb-f85296541eb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4487007e-785e-4b05-b8eb-f85296541eb2', 'volume_size': 1} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:47:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-638705788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4487007e-785e-4b05-b8eb-f85296541eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f5453998a5494fae74517509c05797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:47:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:47:58Z,use_quota=True,user_id='89d9b34c2844448d896278524b81b224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Creating volume 4487007e-785e-4b05-b8eb-f85296541eb2 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:47:57 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:47:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4487007e-785e-4b05-b8eb-f85296541eb2 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:57 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4487007e-785e-4b05-b8eb-f85296541eb2 1073741824 Jul 24 15:47:57 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:58 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4487007e-785e-4b05-b8eb-f85296541eb2 1073741824" returned: 0 in 0.483s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4487007e-785e-4b05-b8eb-f85296541eb2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:47:58 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4487007e-785e-4b05-b8eb-f85296541eb2 Jul 24 15:47:58 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:47:58 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Jul 24 15:47:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4487007e-785e-4b05-b8eb-f85296541eb2" returned: 0 in 0.343s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:47:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:47:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (045e12cc-27a3-455f-9d73-ac719d1c53e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4487007e-785e-4b05-b8eb-f85296541eb2', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b8f586-053b-41f1-91c7-144ea2f9e6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:47:58 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Volume volume-4487007e-785e-4b05-b8eb-f85296541eb2 (4487007e-785e-4b05-b8eb-f85296541eb2): created successfully Jul 24 15:47:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b8f586-053b-41f1-91c7-144ea2f9e6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:47:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Flow 'volume_create_manager' (05acfa5c-e439-4b03-8898-a60c15f2907a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:47:58 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b3a8ceb6-d724-49ec-9817-d791c0ade213 tempest-VolumesTransfersTest-1021333333 None] Created volume successfully. Jul 24 15:47:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-bb42dbc1-f5e0-4055-bdec-81e2c0eb0c34 req-745f1681-244b-45aa-bf48-d9469906b3eb tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:47:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-bb42dbc1-f5e0-4055-bdec-81e2c0eb0c34 req-745f1681-244b-45aa-bf48-d9469906b3eb tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:47:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-bb42dbc1-f5e0-4055-bdec-81e2c0eb0c34 req-745f1681-244b-45aa-bf48-d9469906b3eb tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:47:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-bb42dbc1-f5e0-4055-bdec-81e2c0eb0c34 req-745f1681-244b-45aa-bf48-d9469906b3eb tempest-AttachVolumeNegativeTest-1803157486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ddbe510-97e2-41a9-afca-0dc1a8b41a95', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:47:59 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-bb42dbc1-f5e0-4055-bdec-81e2c0eb0c34 req-745f1681-244b-45aa-bf48-d9469906b3eb tempest-AttachVolumeNegativeTest-1803157486 None] attachment_update completed successfully. Jul 24 15:48:00 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-caea6778-b449-434c-9ba0-863a630065e8 tempest-VolumesTransfersTest-2008019038 None] Transfer volume completed successfully. Jul 24 15:48:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Acquiring lock "cinder-4487007e-785e-4b05-b8eb-f85296541eb2-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Lock "cinder-4487007e-785e-4b05-b8eb-f85296541eb2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Acquiring lock "cinder-quobyte-4487007e-785e-4b05-b8eb-f85296541eb2" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Lock "cinder-quobyte-4487007e-785e-4b05-b8eb-f85296541eb2" acquired by "delete_volume" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:01 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eee66c-9533-4c86-886f-70eac1934e9c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4487007e-785e-4b05-b8eb-f85296541eb2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:01 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4487007e-785e-4b05-b8eb-f85296541eb2 Jul 24 15:48:01 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:02 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-61cc3a8f-2878-42d6-a0ad-66c3e0e0f640 req-65a8b8fb-7a55-4dde-8ec7-6eaa2fac78bb tempest-AttachVolumeNegativeTest-1803157486 None] Terminate volume connection completed successfully. Jul 24 15:48:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-61cc3a8f-2878-42d6-a0ad-66c3e0e0f640 req-65a8b8fb-7a55-4dde-8ec7-6eaa2fac78bb tempest-AttachVolumeNegativeTest-1803157486 None] Deleting attachment 6ddbe510-97e2-41a9-afca-0dc1a8b41a95. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:48:02 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4487007e-785e-4b05-b8eb-f85296541eb2" returned: 0 in 0.465s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4487007e-785e-4b05-b8eb-f85296541eb2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:02 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4487007e-785e-4b05-b8eb-f85296541eb2 Jul 24 15:48:02 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:02 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4487007e-785e-4b05-b8eb-f85296541eb2" returned: 0 in 0.284s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Lock "cinder-quobyte-4487007e-785e-4b05-b8eb-f85296541eb2" released by "delete_volume" :: held 0.798s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:02 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Created reservations ['7973c8b4-5b03-425e-82c6-40f356851a05', '2efbde22-0063-493e-822f-99aae530b4db', 'ccf2461f-bfbd-481b-a257-b11091155bcf', '4c34324b-997c-42af-a22f-30087962c040'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:02 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:02 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:02 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:48:02 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:02 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.389s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:02 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:02 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Deleted volume successfully. Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-818703c4-2457-4834-946c-52211c03ccdd tempest-VolumesTransfersTest-1533590676 None] Lock "cinder-4487007e-785e-4b05-b8eb-f85296541eb2-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Flow 'volume_create_manager' (492ee93e-371e-4b9f-be32-afdc31623529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0417cd4d-eab6-4398-b59f-4870eff9b65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0417cd4d-eab6-4398-b59f-4870eff9b65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1910088414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0790c8c-629f-497f-bb85-f46314ddd8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f5453998a5494fae74517509c05797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:04Z,use_quota=True,user_id='89d9b34c2844448d896278524b81b224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c429105-1d66-4dcf-a660-a64804378a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c429105-1d66-4dcf-a660-a64804378a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e929270-2744-475b-b5c1-ceaa2b9c2b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e929270-2744-475b-b5c1-ceaa2b9c2b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0790c8c-629f-497f-bb85-f46314ddd8d9', 'volume_name': 'volume-b0790c8c-629f-497f-bb85-f46314ddd8d9', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d4d2c1-4227-4d42-9de0-c2e4a219df7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d4d2c1-4227-4d42-9de0-c2e4a219df7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2eea149-6316-494d-84c1-c86fb59d3e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:03 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Volume b0790c8c-629f-497f-bb85-f46314ddd8d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0790c8c-629f-497f-bb85-f46314ddd8d9', 'volume_size': 1} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1910088414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0790c8c-629f-497f-bb85-f46314ddd8d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40f5453998a5494fae74517509c05797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:04Z,use_quota=True,user_id='89d9b34c2844448d896278524b81b224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Creating volume b0790c8c-629f-497f-bb85-f46314ddd8d9 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:03 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:48:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b0790c8c-629f-497f-bb85-f46314ddd8d9 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:03 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b0790c8c-629f-497f-bb85-f46314ddd8d9 1073741824 Jul 24 15:48:03 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:04 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b0790c8c-629f-497f-bb85-f46314ddd8d9 1073741824" returned: 0 in 0.666s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b0790c8c-629f-497f-bb85-f46314ddd8d9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:04 devstack sudo[96358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b0790c8c-629f-497f-bb85-f46314ddd8d9 Jul 24 15:48:04 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:04 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b0790c8c-629f-497f-bb85-f46314ddd8d9" returned: 0 in 0.418s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2eea149-6316-494d-84c1-c86fb59d3e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0790c8c-629f-497f-bb85-f46314ddd8d9', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4730fb-adfc-4e41-994f-1b5627af9bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:05 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Volume volume-b0790c8c-629f-497f-bb85-f46314ddd8d9 (b0790c8c-629f-497f-bb85-f46314ddd8d9): created successfully Jul 24 15:48:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4730fb-adfc-4e41-994f-1b5627af9bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Flow 'volume_create_manager' (492ee93e-371e-4b9f-be32-afdc31623529) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:05 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f828e38a-63a2-4df5-93d1-e746b7b7366c tempest-VolumesTransfersTest-1021333333 None] Created volume successfully. Jul 24 15:48:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Acquiring lock "cinder-b0790c8c-629f-497f-bb85-f46314ddd8d9-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Lock "cinder-b0790c8c-629f-497f-bb85-f46314ddd8d9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Acquiring lock "cinder-quobyte-b0790c8c-629f-497f-bb85-f46314ddd8d9" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Lock "cinder-quobyte-b0790c8c-629f-497f-bb85-f46314ddd8d9" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:06 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed1f247-7975-4dd7-b270-6069dadb9c99]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b0790c8c-629f-497f-bb85-f46314ddd8d9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:06 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b0790c8c-629f-497f-bb85-f46314ddd8d9 Jul 24 15:48:06 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:06 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b0790c8c-629f-497f-bb85-f46314ddd8d9" returned: 0 in 0.562s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b0790c8c-629f-497f-bb85-f46314ddd8d9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:06 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b0790c8c-629f-497f-bb85-f46314ddd8d9 Jul 24 15:48:06 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:07 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b0790c8c-629f-497f-bb85-f46314ddd8d9" returned: 0 in 0.301s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Lock "cinder-quobyte-b0790c8c-629f-497f-bb85-f46314ddd8d9" released by "delete_volume" :: held 0.916s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Flow 'volume_create_manager' (cd1cb8c1-9412-4ff7-8a94-c902fc5a9e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2dd75ee-3d7d-449b-a181-ff58b02166b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2dd75ee-3d7d-449b-a181-ff58b02166b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-638160758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f04e71f-e112-4bbd-a0bb-9292a215e2c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0beb62107bec45bab0c03ad33afc97a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:07Z,use_quota=True,user_id='7b93d4a9331645ca9206eb72eb919b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f41da0-23e3-4d42-b508-8f35041c55a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9f41da0-23e3-4d42-b508-8f35041c55a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c717a52-7966-4ed4-bd69-09fce591a6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c717a52-7966-4ed4-bd69-09fce591a6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f04e71f-e112-4bbd-a0bb-9292a215e2c2', 'volume_name': 'volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2c2cd8-db32-409f-835b-ddbc7d3a0e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a2c2cd8-db32-409f-835b-ddbc7d3a0e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7a7a35-b4dc-40c3-8d9b-b0bdd5c5884e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:07 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Volume 9f04e71f-e112-4bbd-a0bb-9292a215e2c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2', 'volume_size': 1} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-638160758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f04e71f-e112-4bbd-a0bb-9292a215e2c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0beb62107bec45bab0c03ad33afc97a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:07Z,use_quota=True,user_id='7b93d4a9331645ca9206eb72eb919b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Creating volume 9f04e71f-e112-4bbd-a0bb-9292a215e2c2 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:07 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Created reservations ['5496593c-b0c3-44ef-94d7-ce6ae60299e6', '495f0445-42a4-4585-8990-20119eb9c519', 'dc420d1f-b705-43ef-bee6-4849dea09a7c', '9d7251f2-2d50-4e07-9a63-e05cd67805a3'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:07 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2 1073741824 Jul 24 15:48:07 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:07 devstack sudo[96376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:48:07 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:07 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.384s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:07 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Deleted volume successfully. Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6aef6473-1f32-4b7e-8884-529179672ef1 tempest-VolumesTransfersTest-1533590676 None] Lock "cinder-b0790c8c-629f-497f-bb85-f46314ddd8d9-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:07 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2 1073741824" returned: 0 in 0.618s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:07 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2 Jul 24 15:48:07 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:08 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2" returned: 0 in 0.285s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7a7a35-b4dc-40c3-8d9b-b0bdd5c5884e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826d8906-38c6-459d-8bdc-56e3d6e6264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:08 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Volume volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2 (9f04e71f-e112-4bbd-a0bb-9292a215e2c2): created successfully Jul 24 15:48:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826d8906-38c6-459d-8bdc-56e3d6e6264e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Flow 'volume_create_manager' (cd1cb8c1-9412-4ff7-8a94-c902fc5a9e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:08 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d2d2ca20-7783-4d77-8c87-3d8cc16d4cc5 tempest-AttachVolumeTestJSON-255636830 None] Created volume successfully. Jul 24 15:48:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-719d0730-8a20-42b0-971c-3ae3e880df7b req-d0e38a6a-aa4c-45c7-b723-ccdf9d66e518 tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-719d0730-8a20-42b0-971c-3ae3e880df7b req-d0e38a6a-aa4c-45c7-b723-ccdf9d66e518 tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-719d0730-8a20-42b0-971c-3ae3e880df7b req-d0e38a6a-aa4c-45c7-b723-ccdf9d66e518 tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-719d0730-8a20-42b0-971c-3ae3e880df7b req-d0e38a6a-aa4c-45c7-b723-ccdf9d66e518 tempest-AttachVolumeTestJSON-255636830 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce4d7478-ee56-4832-9020-b3102e57d960', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:48:10 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-719d0730-8a20-42b0-971c-3ae3e880df7b req-d0e38a6a-aa4c-45c7-b723-ccdf9d66e518 tempest-AttachVolumeTestJSON-255636830 None] attachment_update completed successfully. Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Flow 'volume_create_manager' (f78d28b9-a6c3-43aa-bd32-6fbb22082ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f42e22-bcb0-4762-ae3d-b7c31ba12524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f42e22-bcb0-4762-ae3d-b7c31ba12524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1003195426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feac92d0-c9cb-494d-b7b8-79a8efa33bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0beb62107bec45bab0c03ad33afc97a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:14Z,use_quota=True,user_id='7b93d4a9331645ca9206eb72eb919b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff46224b-5999-44f8-9a52-19eaf38a017c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff46224b-5999-44f8-9a52-19eaf38a017c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8929a5b-6c71-4659-a2b4-dd9305c55d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8929a5b-6c71-4659-a2b4-dd9305c55d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feac92d0-c9cb-494d-b7b8-79a8efa33bbd', 'volume_name': 'volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eca748b-c1fd-424a-a6ac-65ea9903aeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eca748b-c1fd-424a-a6ac-65ea9903aeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe41ce4-acee-49d2-a8a6-86cf989e8942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:13 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Volume feac92d0-c9cb-494d-b7b8-79a8efa33bbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd', 'volume_size': 1} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1003195426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feac92d0-c9cb-494d-b7b8-79a8efa33bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0beb62107bec45bab0c03ad33afc97a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:14Z,use_quota=True,user_id='7b93d4a9331645ca9206eb72eb919b19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Creating volume feac92d0-c9cb-494d-b7b8-79a8efa33bbd {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:13 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:48:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:13 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd 1073741824 Jul 24 15:48:13 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:14 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd 1073741824" returned: 0 in 0.806s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:14 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd Jul 24 15:48:14 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:14 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd" returned: 0 in 0.358s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe41ce4-acee-49d2-a8a6-86cf989e8942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba341d04-e728-46cc-9f3c-7b75aefb08ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:15 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Volume volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd (feac92d0-c9cb-494d-b7b8-79a8efa33bbd): created successfully Jul 24 15:48:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba341d04-e728-46cc-9f3c-7b75aefb08ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Flow 'volume_create_manager' (f78d28b9-a6c3-43aa-bd32-6fbb22082ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:15 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e1e89f89-d8a9-4aa1-8460-0a809e422bcc tempest-AttachVolumeTestJSON-255636830 None] Created volume successfully. Jul 24 15:48:16 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=112,cinder:UPDATE=120,cinder:DELETE=12,cinder:INSERT=24 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:48:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-04dc3d4f-c672-47aa-be7d-900e0e268e82 req-8ac7627a-8c0c-4fc7-8b7e-7083cffb14cf tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-04dc3d4f-c672-47aa-be7d-900e0e268e82 req-8ac7627a-8c0c-4fc7-8b7e-7083cffb14cf tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-04dc3d4f-c672-47aa-be7d-900e0e268e82 req-8ac7627a-8c0c-4fc7-8b7e-7083cffb14cf tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-04dc3d4f-c672-47aa-be7d-900e0e268e82 req-8ac7627a-8c0c-4fc7-8b7e-7083cffb14cf tempest-AttachVolumeTestJSON-255636830 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12fa69c0-fb06-4225-b9d6-7d5923ccf225', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:48:16 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-04dc3d4f-c672-47aa-be7d-900e0e268e82 req-8ac7627a-8c0c-4fc7-8b7e-7083cffb14cf tempest-AttachVolumeTestJSON-255636830 None] attachment_update completed successfully. Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Flow 'volume_create_manager' (9b1f2f4b-e36b-4b34-b3a9-b78da53b1a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d55a29-c290-441b-b37a-559e1995c2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d55a29-c290-441b-b37a-559e1995c2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1180627049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e451e27f-50f0-4950-bfae-bc28df94f777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc05ec09f194e0c896e3782d30d0ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:20Z,use_quota=True,user_id='a902fad72f91416cba61c2e64c96feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1220e28a-0b4c-4b59-8ae7-212458f3b4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1220e28a-0b4c-4b59-8ae7-212458f3b4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4ba112-aeb9-4ad6-9edf-8042bd47faec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e4ba112-aeb9-4ad6-9edf-8042bd47faec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e451e27f-50f0-4950-bfae-bc28df94f777', 'volume_name': 'volume-e451e27f-50f0-4950-bfae-bc28df94f777', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a612ab2d-d966-442d-bf33-a6da3219bc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a612ab2d-d966-442d-bf33-a6da3219bc39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac9ffce-b66f-4b63-a65c-26b2d5fefce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:20 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Volume e451e27f-50f0-4950-bfae-bc28df94f777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e451e27f-50f0-4950-bfae-bc28df94f777', 'volume_size': 1} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1180627049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e451e27f-50f0-4950-bfae-bc28df94f777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc05ec09f194e0c896e3782d30d0ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:20Z,use_quota=True,user_id='a902fad72f91416cba61c2e64c96feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Creating volume e451e27f-50f0-4950-bfae-bc28df94f777 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:20 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e451e27f-50f0-4950-bfae-bc28df94f777 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:20 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e451e27f-50f0-4950-bfae-bc28df94f777 1073741824 Jul 24 15:48:20 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:20 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-422794ae-6c86-42a5-968e-0e1ad325c93a req-f11d8c1b-f1e9-41a7-b609-df8b87fdbece tempest-AttachVolumeTestJSON-255636830 None] Terminate volume connection completed successfully. Jul 24 15:48:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-422794ae-6c86-42a5-968e-0e1ad325c93a req-f11d8c1b-f1e9-41a7-b609-df8b87fdbece tempest-AttachVolumeTestJSON-255636830 None] Deleting attachment ce4d7478-ee56-4832-9020-b3102e57d960. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:48:21 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e451e27f-50f0-4950-bfae-bc28df94f777 1073741824" returned: 0 in 0.691s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e451e27f-50f0-4950-bfae-bc28df94f777 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:21 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e451e27f-50f0-4950-bfae-bc28df94f777 Jul 24 15:48:21 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:21 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e451e27f-50f0-4950-bfae-bc28df94f777" returned: 0 in 0.677s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac9ffce-b66f-4b63-a65c-26b2d5fefce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e451e27f-50f0-4950-bfae-bc28df94f777', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c19808-0023-4781-aac1-d4fbf8e8e26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:21 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Volume volume-e451e27f-50f0-4950-bfae-bc28df94f777 (e451e27f-50f0-4950-bfae-bc28df94f777): created successfully Jul 24 15:48:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c19808-0023-4781-aac1-d4fbf8e8e26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Flow 'volume_create_manager' (9b1f2f4b-e36b-4b34-b3a9-b78da53b1a5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:21 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-aee8d0e3-0013-441d-8b23-7f390bde330a tempest-VolumesTransfersV355Test-546303864 None] Created volume successfully. Jul 24 15:48:22 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-6138038c-5077-4b15-ae55-b3fbb2023653 req-958563b8-7f0c-4592-a567-ea4478ee6664 tempest-AttachVolumeTestJSON-255636830 None] Terminate volume connection completed successfully. Jul 24 15:48:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-6138038c-5077-4b15-ae55-b3fbb2023653 req-958563b8-7f0c-4592-a567-ea4478ee6664 tempest-AttachVolumeTestJSON-255636830 None] Deleting attachment 12fa69c0-fb06-4225-b9d6-7d5923ccf225. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:48:23 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-78129ee2-fc20-4d4d-923a-3d03dfe53cbf tempest-VolumesTransfersV355Test-1093087950 None] Transfer volume completed successfully. Jul 24 15:48:25 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Acquiring lock "cinder-e451e27f-50f0-4950-bfae-bc28df94f777-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:25 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Lock "cinder-e451e27f-50f0-4950-bfae-bc28df94f777-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:25 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Acquiring lock "cinder-quobyte-e451e27f-50f0-4950-bfae-bc28df94f777" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:25 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Lock "cinder-quobyte-e451e27f-50f0-4950-bfae-bc28df94f777" acquired by "delete_volume" :: waited 0.036s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:25 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafb9c0c-897d-49d0-93e6-5d0b7989ee45]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e451e27f-50f0-4950-bfae-bc28df94f777 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:26 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e451e27f-50f0-4950-bfae-bc28df94f777 Jul 24 15:48:26 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:26 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e451e27f-50f0-4950-bfae-bc28df94f777" returned: 0 in 0.605s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e451e27f-50f0-4950-bfae-bc28df94f777 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:26 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e451e27f-50f0-4950-bfae-bc28df94f777 Jul 24 15:48:26 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:27 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e451e27f-50f0-4950-bfae-bc28df94f777" returned: 0 in 0.674s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Lock "cinder-quobyte-e451e27f-50f0-4950-bfae-bc28df94f777" released by "delete_volume" :: held 1.388s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:27 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Created reservations ['666b521d-3f1c-481d-acd9-ecd87719b704', '1d8a5d31-ce39-478d-9895-754a4cd6346e', '8ef8300f-f4d7-45e3-a9f3-59fb1f3fa55c', '48436e15-148a-43d7-9ed3-30b9ec2ac11d'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:27 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:48:27 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:27 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.397s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:27 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:27 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Deleted volume successfully. Jul 24 15:48:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-67fdd00f-77af-4dc4-8f78-14d795cdd3cb tempest-VolumesTransfersV355Test-1696336051 None] Lock "cinder-e451e27f-50f0-4950-bfae-bc28df94f777-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Flow 'volume_create_manager' (c324c136-1291-4f17-92f3-fd2ee6889cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4672e50-d898-4995-b2b4-97154e1e82d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4672e50-d898-4995-b2b4-97154e1e82d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-813459986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652e9bbc-8d98-431f-920b-747ae8b19475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc05ec09f194e0c896e3782d30d0ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:29Z,use_quota=True,user_id='a902fad72f91416cba61c2e64c96feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91f837b-152a-42a9-8360-01e25e121719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d91f837b-152a-42a9-8360-01e25e121719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3a613f-5408-4353-ad2f-072ba5b7844b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3a613f-5408-4353-ad2f-072ba5b7844b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '652e9bbc-8d98-431f-920b-747ae8b19475', 'volume_name': 'volume-652e9bbc-8d98-431f-920b-747ae8b19475', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f074a1-b54a-424d-bba8-9a5633dfee2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1f074a1-b54a-424d-bba8-9a5633dfee2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2b26da-41cb-4124-8261-dc1bcf515b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:29 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Volume 652e9bbc-8d98-431f-920b-747ae8b19475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-652e9bbc-8d98-431f-920b-747ae8b19475', 'volume_size': 1} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-813459986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652e9bbc-8d98-431f-920b-747ae8b19475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cc05ec09f194e0c896e3782d30d0ad2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:29Z,use_quota=True,user_id='a902fad72f91416cba61c2e64c96feb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Creating volume 652e9bbc-8d98-431f-920b-747ae8b19475 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:29 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:48:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-652e9bbc-8d98-431f-920b-747ae8b19475 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:29 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-652e9bbc-8d98-431f-920b-747ae8b19475 1073741824 Jul 24 15:48:29 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "cinder-feac92d0-c9cb-494d-b7b8-79a8efa33bbd-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Lock "cinder-feac92d0-c9cb-494d-b7b8-79a8efa33bbd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:30 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-652e9bbc-8d98-431f-920b-747ae8b19475 1073741824" returned: 0 in 0.742s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "cinder-quobyte-feac92d0-c9cb-494d-b7b8-79a8efa33bbd" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Lock "cinder-quobyte-feac92d0-c9cb-494d-b7b8-79a8efa33bbd" acquired by "delete_volume" :: waited 0.044s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-652e9bbc-8d98-431f-920b-747ae8b19475 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:30 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[552119d2-348b-4a1e-972f-8e024b3cd627]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:30 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-652e9bbc-8d98-431f-920b-747ae8b19475 Jul 24 15:48:30 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:30 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd Jul 24 15:48:30 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:30 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-652e9bbc-8d98-431f-920b-747ae8b19475" returned: 0 in 0.482s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:30 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2b26da-41cb-4124-8261-dc1bcf515b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-652e9bbc-8d98-431f-920b-747ae8b19475', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddecf888-d10c-4509-b2bf-744da075b9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd" returned: 0 in 0.539s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:31 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Volume volume-652e9bbc-8d98-431f-920b-747ae8b19475 (652e9bbc-8d98-431f-920b-747ae8b19475): created successfully Jul 24 15:48:31 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddecf888-d10c-4509-b2bf-744da075b9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:31 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Flow 'volume_create_manager' (c324c136-1291-4f17-92f3-fd2ee6889cff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:31 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd Jul 24 15:48:31 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:31 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-0750924e-eb3d-4da9-afb8-7388bc71c754 tempest-VolumesTransfersV355Test-546303864 None] Created volume successfully. Jul 24 15:48:31 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-feac92d0-c9cb-494d-b7b8-79a8efa33bbd" returned: 0 in 0.424s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Lock "cinder-quobyte-feac92d0-c9cb-494d-b7b8-79a8efa33bbd" released by "delete_volume" :: held 1.027s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:31 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Created reservations ['0c220f2e-019e-4289-9e8c-396a0913ca7f', '762685a2-14dc-485c-a21e-45ed8851a076', '11fe3072-b1e5-4567-9ee9-6b64f954625c', 'c7c41412-3578-47e4-9d0c-1045b7cb5646'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:31 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:48:31 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:32 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.417s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Acquiring lock "cinder-652e9bbc-8d98-431f-920b-747ae8b19475-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:32 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Deleted volume successfully. Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Lock "cinder-652e9bbc-8d98-431f-920b-747ae8b19475-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a6f5efac-9907-49bc-aff5-37f37473b6bc tempest-AttachVolumeTestJSON-255636830 None] Lock "cinder-feac92d0-c9cb-494d-b7b8-79a8efa33bbd-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Acquiring lock "cinder-quobyte-652e9bbc-8d98-431f-920b-747ae8b19475" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Lock "cinder-quobyte-652e9bbc-8d98-431f-920b-747ae8b19475" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ed0ac5-4dd5-4beb-8a86-3b4ee653e37e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-652e9bbc-8d98-431f-920b-747ae8b19475 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:32 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-652e9bbc-8d98-431f-920b-747ae8b19475 Jul 24 15:48:32 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "cinder-9f04e71f-e112-4bbd-a0bb-9292a215e2c2-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Lock "cinder-9f04e71f-e112-4bbd-a0bb-9292a215e2c2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "cinder-quobyte-9f04e71f-e112-4bbd-a0bb-9292a215e2c2" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Lock "cinder-quobyte-9f04e71f-e112-4bbd-a0bb-9292a215e2c2" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5aa4ba7-b257-49bf-a7bf-73d0ace35207]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:32 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-652e9bbc-8d98-431f-920b-747ae8b19475" returned: 0 in 0.570s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-652e9bbc-8d98-431f-920b-747ae8b19475 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:32 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2 Jul 24 15:48:32 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:32 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-652e9bbc-8d98-431f-920b-747ae8b19475 Jul 24 15:48:32 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:33 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2" returned: 0 in 0.442s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:33 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-652e9bbc-8d98-431f-920b-747ae8b19475" returned: 0 in 0.347s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:33 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2 Jul 24 15:48:33 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Lock "cinder-quobyte-652e9bbc-8d98-431f-920b-747ae8b19475" released by "delete_volume" :: held 0.963s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Created reservations ['3a2789d5-f6b2-4199-a41c-a331e378a3e2', 'e803c7d1-9060-46ec-a2cb-75315a25dea9', '46539337-5ef9-4953-81a3-93defbe9bb1d', 'eac39e65-ac9d-4542-a0c4-0ff02ec16e87'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:33 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:48:33 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:33 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9f04e71f-e112-4bbd-a0bb-9292a215e2c2" returned: 0 in 0.367s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Lock "cinder-quobyte-9f04e71f-e112-4bbd-a0bb-9292a215e2c2" released by "delete_volume" :: held 0.868s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Created reservations ['7bf029f3-c8ae-47bc-ad31-29bfcc096e4e', '8b225e2f-92ce-43d6-b0bb-f619a76cf6ef', '6b2a5f82-cf4e-464b-8ff7-29f750a148fe', 'd96a10c9-054e-441b-a350-0ccaa289df90'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:33 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:48:33 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:33 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.399s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:33 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Deleted volume successfully. Jul 24 15:48:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e78296b9-0e3b-47a3-87c0-bd3e8c079c9b tempest-VolumesTransfersV355Test-1696336051 None] Lock "cinder-652e9bbc-8d98-431f-920b-747ae8b19475-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "cinder-09d365b0-7b1b-4828-a73e-0ec39b763b34-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Lock "cinder-09d365b0-7b1b-4828-a73e-0ec39b763b34-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "cinder-quobyte-09d365b0-7b1b-4828-a73e-0ec39b763b34" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Lock "cinder-quobyte-09d365b0-7b1b-4828-a73e-0ec39b763b34" acquired by "delete_volume" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:34 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4a447c-9440-435d-9917-6632f50c6a31]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-09d365b0-7b1b-4828-a73e-0ec39b763b34 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:34 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.373s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:34 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:34 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Deleted volume successfully. Jul 24 15:48:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b08bd8d4-67d5-4a6a-b4b5-5a43c281d64d tempest-AttachVolumeTestJSON-255636830 None] Lock "cinder-9f04e71f-e112-4bbd-a0bb-9292a215e2c2-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:34 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-09d365b0-7b1b-4828-a73e-0ec39b763b34 Jul 24 15:48:34 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:34 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-09d365b0-7b1b-4828-a73e-0ec39b763b34" returned: 0 in 0.412s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-09d365b0-7b1b-4828-a73e-0ec39b763b34 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:34 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-09d365b0-7b1b-4828-a73e-0ec39b763b34 Jul 24 15:48:34 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:34 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-09d365b0-7b1b-4828-a73e-0ec39b763b34" returned: 0 in 0.263s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Lock "cinder-quobyte-09d365b0-7b1b-4828-a73e-0ec39b763b34" released by "delete_volume" :: held 0.724s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:34 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Created reservations ['db7806b0-7c39-4924-8678-07bb16e4c1f0', '43de384b-c278-407b-b84a-01cad2ec0e97', '105df99c-9dee-417b-b284-dd5cd3136ca5', '2b9b8f43-212a-4dad-a428-577f76436789'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:35 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:48:35 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:35 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.345s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:35 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Deleted volume successfully. Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-45a5695c-2183-4906-a2fd-827dda7fc751 tempest-AttachVolumeTestJSON-255636830 None] Lock "cinder-09d365b0-7b1b-4828-a73e-0ec39b763b34-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Flow 'volume_create_manager' (d76ebc4b-7b02-4439-8541-c48ae936dd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28878214-fe4d-48e9-8f33-4ebdd1e68868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28878214-fe4d-48e9-8f33-4ebdd1e68868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-957281616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8140897-7ab7-4eb1-ba5d-009d5b1c1011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4cc68a658694629b1741d3d499a20fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:35Z,use_quota=True,user_id='9795505c37fa43159f55537acf1fb060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e40d0bfa-45cc-4e9f-9681-84de0e4db9a3),volume_type_id=e40d0bfa-45cc-4e9f-9681-84de0e4db9a3)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a566e2-9e5d-4625-b516-a4f9acf86e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7a566e2-9e5d-4625-b516-a4f9acf86e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd0b5f0-a553-4604-ab55-c04a727c7014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfd0b5f0-a553-4604-ab55-c04a727c7014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8140897-7ab7-4eb1-ba5d-009d5b1c1011', 'volume_name': 'volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78922c34-8844-4506-a567-b070d3e7eb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78922c34-8844-4506-a567-b070d3e7eb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d60919-b662-4723-b0ab-6d86696fac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:35 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Volume a8140897-7ab7-4eb1-ba5d-009d5b1c1011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011', 'volume_size': 1} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-957281616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8140897-7ab7-4eb1-ba5d-009d5b1c1011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4cc68a658694629b1741d3d499a20fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:35Z,use_quota=True,user_id='9795505c37fa43159f55537acf1fb060',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e40d0bfa-45cc-4e9f-9681-84de0e4db9a3),volume_type_id=e40d0bfa-45cc-4e9f-9681-84de0e4db9a3)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Creating volume a8140897-7ab7-4eb1-ba5d-009d5b1c1011 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:35 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:48:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:35 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011 1073741824 Jul 24 15:48:35 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:36 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011 1073741824" returned: 0 in 0.543s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:36 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011 Jul 24 15:48:36 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:36 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011" returned: 0 in 0.305s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:36 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d60919-b662-4723-b0ab-6d86696fac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c052ff7c-1a93-494f-8391-3ce851cb9a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:36 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Volume volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011 (a8140897-7ab7-4eb1-ba5d-009d5b1c1011): created successfully Jul 24 15:48:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c052ff7c-1a93-494f-8391-3ce851cb9a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Flow 'volume_create_manager' (d76ebc4b-7b02-4439-8541-c48ae936dd39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:36 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-09740db4-2a54-40e6-bf90-1d6e0943612b tempest-VolumeTypesAccessTest-869999314 None] Created volume successfully. Jul 24 15:48:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Acquiring lock "cinder-a8140897-7ab7-4eb1-ba5d-009d5b1c1011-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Lock "cinder-a8140897-7ab7-4eb1-ba5d-009d5b1c1011-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Acquiring lock "cinder-quobyte-a8140897-7ab7-4eb1-ba5d-009d5b1c1011" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Lock "cinder-quobyte-a8140897-7ab7-4eb1-ba5d-009d5b1c1011" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:37 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cb0af8-fb9a-4511-bcfb-6fc1bc6611d0]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:37 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011 Jul 24 15:48:37 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:38 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011" returned: 0 in 0.425s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:38 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011 Jul 24 15:48:38 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:38 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a8140897-7ab7-4eb1-ba5d-009d5b1c1011" returned: 0 in 0.295s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:38 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Lock "cinder-quobyte-a8140897-7ab7-4eb1-ba5d-009d5b1c1011" released by "delete_volume" :: held 0.778s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:38 devstack cinder-volume[88350]: WARNING cinder.quota [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1475602514 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1475602514, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:48:38 devstack cinder-volume[88350]: WARNING cinder.quota [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1475602514 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1475602514, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:48:38 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Created reservations ['cff74bf3-d971-4ac5-ad8d-baffc1cc3f46', 'e51b64b2-0bf1-4de8-8ff3-a87a4fd36836', '6c371bef-65a2-413c-a0f0-412fb168a6d6', '83a853d8-5336-4823-891d-57c8dc56d70d'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:38 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:48:38 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:38 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.304s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:38 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:38 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Deleted volume successfully. Jul 24 15:48:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9ba4966a-b705-4c87-9f1a-bb238207c6b5 tempest-VolumeTypesAccessTest-869999314 None] Lock "cinder-a8140897-7ab7-4eb1-ba5d-009d5b1c1011-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:48:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:40 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:48:40 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:40 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.551s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:48:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:48:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Flow 'volume_create_manager' (c9270f1e-bd07-450b-9a3b-aa95b1a68383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c96595-75db-483c-9a25-455f8b04d623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c96595-75db-483c-9a25-455f8b04d623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-722034490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d60ab50-274b-476f-9635-c1bed45d77a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0567f85f118a4be3a12a3d2579102d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:46Z,use_quota=True,user_id='2a26055bcf174b2fbbc34995647d6ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cc3c25-5d1b-4452-9099-a7f4c26d5f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9cc3c25-5d1b-4452-9099-a7f4c26d5f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90263f85-d14a-4ed0-8402-4c01722e789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90263f85-d14a-4ed0-8402-4c01722e789a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d60ab50-274b-476f-9635-c1bed45d77a8', 'volume_name': 'volume-2d60ab50-274b-476f-9635-c1bed45d77a8', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a90240e-6e95-431a-8fe7-2bfb7b9a81f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a90240e-6e95-431a-8fe7-2bfb7b9a81f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b129f8da-60e3-4ff7-bdcc-6b5f34b9f048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:45 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Volume 2d60ab50-274b-476f-9635-c1bed45d77a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d60ab50-274b-476f-9635-c1bed45d77a8', 'volume_size': 1} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-722034490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d60ab50-274b-476f-9635-c1bed45d77a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0567f85f118a4be3a12a3d2579102d24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:46Z,use_quota=True,user_id='2a26055bcf174b2fbbc34995647d6ddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Creating volume 2d60ab50-274b-476f-9635-c1bed45d77a8 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:45 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:48:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:45 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8 1073741824 Jul 24 15:48:45 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:46 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8 1073741824" returned: 0 in 0.716s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:46 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8 Jul 24 15:48:46 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:46 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8" returned: 0 in 0.387s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:46 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b129f8da-60e3-4ff7-bdcc-6b5f34b9f048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d60ab50-274b-476f-9635-c1bed45d77a8', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf31b119-36a0-49d8-944b-6206b22c35c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:46 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Volume volume-2d60ab50-274b-476f-9635-c1bed45d77a8 (2d60ab50-274b-476f-9635-c1bed45d77a8): created successfully Jul 24 15:48:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf31b119-36a0-49d8-944b-6206b22c35c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Flow 'volume_create_manager' (c9270f1e-bd07-450b-9a3b-aa95b1a68383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:46 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-64fd4f11-7827-4bab-bdbb-48c6aa5f305a req-eb6fdf6a-8c9b-42d5-8eb3-20fa22f7963d tempest-VolumesSnapshotsTestJSON-1249643055 None] Created volume successfully. Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Flow 'volume_create_manager' (650b9da1-0db3-457f-a2a0-65231b59a7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c004d7-5fe0-4b63-ad14-7a6d2a673516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1c004d7-5fe0-4b63-ad14-7a6d2a673516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-220909095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75cf1b46-6b8b-4b78-adf9-590dccabb906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba17de3289db46469403f207bdd9877a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:47Z,use_quota=True,user_id='9bf314cec59347699e00152a45507da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f0075d-e5c8-4f4f-8f45-e625b8b86bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f0075d-e5c8-4f4f-8f45-e625b8b86bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f53a7d2-14b6-4a0a-ac90-871bdec75452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f53a7d2-14b6-4a0a-ac90-871bdec75452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75cf1b46-6b8b-4b78-adf9-590dccabb906', 'volume_name': 'volume-75cf1b46-6b8b-4b78-adf9-590dccabb906', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbd8882-007f-4e5a-bdf4-8e47f14fb4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbd8882-007f-4e5a-bdf4-8e47f14fb4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87b9636-c55a-4755-86f0-5502f227bc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:47 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Volume 75cf1b46-6b8b-4b78-adf9-590dccabb906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75cf1b46-6b8b-4b78-adf9-590dccabb906', 'volume_size': 1} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-220909095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75cf1b46-6b8b-4b78-adf9-590dccabb906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba17de3289db46469403f207bdd9877a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:47Z,use_quota=True,user_id='9bf314cec59347699e00152a45507da5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Creating volume 75cf1b46-6b8b-4b78-adf9-590dccabb906 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:47 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-75cf1b46-6b8b-4b78-adf9-590dccabb906 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:47 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-75cf1b46-6b8b-4b78-adf9-590dccabb906 1073741824 Jul 24 15:48:47 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:47 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-75cf1b46-6b8b-4b78-adf9-590dccabb906 1073741824" returned: 0 in 0.624s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-75cf1b46-6b8b-4b78-adf9-590dccabb906 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:48 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-75cf1b46-6b8b-4b78-adf9-590dccabb906 Jul 24 15:48:48 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:48 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-75cf1b46-6b8b-4b78-adf9-590dccabb906" returned: 0 in 0.362s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.168s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87b9636-c55a-4755-86f0-5502f227bc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75cf1b46-6b8b-4b78-adf9-590dccabb906', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c570b9e5-ea9d-4ffa-b9eb-95a6421e6135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] Creating offline snapshot ab210426-0330-41ec-a83b-259a931bfc69 of volume 2d60ab50-274b-476f-9635-c1bed45d77a8 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:48:48 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Volume volume-75cf1b46-6b8b-4b78-adf9-590dccabb906 (75cf1b46-6b8b-4b78-adf9-590dccabb906): created successfully Jul 24 15:48:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c570b9e5-ea9d-4ffa-b9eb-95a6421e6135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Flow 'volume_create_manager' (650b9da1-0db3-457f-a2a0-65231b59a7a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:48 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e28a25d-fdae-4f43-af34-235993dea008]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:48 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-50e3d028-26ca-4c99-9d4b-e3b5395436c5 tempest-AttachVolumeNegativeTest-1803157486 None] Created volume successfully. Jul 24 15:48:48 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8 Jul 24 15:48:48 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:48 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8" returned: 0 in 0.408s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:48 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69 1G Jul 24 15:48:48 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:49 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69 1G" returned: 0 in 0.632s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d60ab50-274b-476f-9635-c1bed45d77a8 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:49 devstack sudo[97155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d60ab50-274b-476f-9635-c1bed45d77a8 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69 Jul 24 15:48:49 devstack sudo[97155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:50 devstack sudo[97155]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d60ab50-274b-476f-9635-c1bed45d77a8 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69" returned: 0 in 0.531s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:50 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69 is being set with open permissions: ugo+rw Jul 24 15:48:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:50 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69 Jul 24 15:48:50 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-f7f5323e-b6fb-4596-b4d0-f1e07ef61599 req-16988eb6-81e3-484d-8b1e-b38d530053aa tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:50 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69" returned: 0 in 0.361s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:50 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.info Jul 24 15:48:50 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:50 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.info" returned: 0 in 0.399s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:50 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.info is being set with open permissions: ugo+rw Jul 24 15:48:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:50 devstack sudo[97176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.info Jul 24 15:48:50 devstack sudo[97176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:51 devstack sudo[97176]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.info" returned: 0 in 0.346s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.882s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-f7f5323e-b6fb-4596-b4d0-f1e07ef61599 req-16988eb6-81e3-484d-8b1e-b38d530053aa tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.875s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:51 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=113,cinder:SELECT=98,cinder:DELETE=7,cinder:INSERT=23 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:48:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-f7f5323e-b6fb-4596-b4d0-f1e07ef61599 req-16988eb6-81e3-484d-8b1e-b38d530053aa tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:51 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-6875fe61-e707-4d42-8d02-d38dfcc9b5cc req-f613d930-6c7e-486b-b9a8-9cca1fc86f3d tempest-VolumesSnapshotsTestJSON-1249643055 None] Create snapshot completed successfully Jul 24 15:48:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-f7f5323e-b6fb-4596-b4d0-f1e07ef61599 req-16988eb6-81e3-484d-8b1e-b38d530053aa tempest-AttachVolumeNegativeTest-1803157486 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-75cf1b46-6b8b-4b78-adf9-590dccabb906', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3be4a8df-4a9b-4a3f-a76c-dbe2703430ac', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:48:51 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-f7f5323e-b6fb-4596-b4d0-f1e07ef61599 req-16988eb6-81e3-484d-8b1e-b38d530053aa tempest-AttachVolumeNegativeTest-1803157486 None] attachment_update completed successfully. Jul 24 15:48:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Acquiring lock "cinder-ab210426-0330-41ec-a83b-259a931bfc69-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "cinder-ab210426-0330-41ec-a83b-259a931bfc69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Acquiring lock "cinder-quobyte-2d60ab50-274b-476f-9635-c1bed45d77a8" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "cinder-quobyte-2d60ab50-274b-476f-9635-c1bed45d77a8" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Acquiring lock "cinder-quobyte-ab210426-0330-41ec-a83b-259a931bfc69" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "cinder-quobyte-ab210426-0330-41ec-a83b-259a931bfc69" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Deleting offline snapshot ab210426-0330-41ec-a83b-259a931bfc69 of volume 2d60ab50-274b-476f-9635-c1bed45d77a8 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:48:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] snapshot_file for this snap is: volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:48:52 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b348ce19-d549-4144-bf43-0cdc61745840]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:52 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69 Jul 24 15:48:52 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:52 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69" returned: 0 in 0.503s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d60ab50-274b-476f-9635-c1bed45d77a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:48:52 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21123f2-777a-49ec-ab36-7ab62c5ec580]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:52 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8 Jul 24 15:48:52 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:53 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8" returned: 0 in 0.478s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:53 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69 Jul 24 15:48:53 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:53 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69" returned: 0 in 0.496s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:53 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69 Jul 24 15:48:53 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:54 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8.ab210426-0330-41ec-a83b-259a931bfc69" returned: 0 in 0.328s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "cinder-quobyte-ab210426-0330-41ec-a83b-259a931bfc69" released by "_delete_snapshot" :: held 1.989s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "cinder-quobyte-2d60ab50-274b-476f-9635-c1bed45d77a8" released by "delete_snapshot" :: held 2.052s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:54 devstack cinder-volume[88350]: DEBUG cinder.quota [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Created reservations ['73e5547e-4007-4bd9-b907-7a164dfa80d6', '9afd8da8-1d63-4db8-9687-2f5e6a3ac999', 'cd19c94c-039e-47ec-951f-3ddcf1153c2c', 'bc78046e-81e5-4941-9a59-05e367fb6b53'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:54 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Delete snapshot completed successfully. Jul 24 15:48:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-f7a215dd-db1f-4c5a-a952-4fe83b80654a req-a718a7a2-7fac-4c30-91ab-13a9a212e0cb tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "cinder-ab210426-0330-41ec-a83b-259a931bfc69-delete_snapshot" released by "delete_snapshot" :: held 2.292s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:54 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-a5e97dfc-14c3-4cd8-bee0-c1736c3b0262 req-55367178-ca4b-4120-931f-20bf4dd609e6 tempest-AttachVolumeNegativeTest-1803157486 None] Terminate volume connection completed successfully. Jul 24 15:48:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-a5e97dfc-14c3-4cd8-bee0-c1736c3b0262 req-55367178-ca4b-4120-931f-20bf4dd609e6 tempest-AttachVolumeNegativeTest-1803157486 None] Deleting attachment 3be4a8df-4a9b-4a3f-a76c-dbe2703430ac. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:48:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Acquiring lock "cinder-2d60ab50-274b-476f-9635-c1bed45d77a8-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "cinder-2d60ab50-274b-476f-9635-c1bed45d77a8-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Acquiring lock "cinder-quobyte-2d60ab50-274b-476f-9635-c1bed45d77a8" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:48:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "cinder-quobyte-2d60ab50-274b-476f-9635-c1bed45d77a8" acquired by "delete_volume" :: waited 0.035s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:48:55 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8d000e-c326-44e9-8a51-0a8a572d19eb]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:48:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:56 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8 Jul 24 15:48:56 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:56 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8" returned: 0 in 0.720s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:56 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8 Jul 24 15:48:56 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Flow 'volume_create_manager' (9c5d093d-d0f5-4309-96ef-0423eeeb351d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dedefa1-2cf8-4dea-9375-f5ff398e1909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:57 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dedefa1-2cf8-4dea-9375-f5ff398e1909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1983579970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0662721b-b0ce-486a-b528-08dee966d4e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc0572645884907b1a3c33932e35ff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:57Z,use_quota=True,user_id='fd743f8e19db4a36974872d1b76e2f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7a96c5-62c7-4444-8f91-d40209d8a34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7a96c5-62c7-4444-8f91-d40209d8a34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a24e632-73f1-4e53-b4fd-695880b0ce9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a24e632-73f1-4e53-b4fd-695880b0ce9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0662721b-b0ce-486a-b528-08dee966d4e1', 'volume_name': 'volume-0662721b-b0ce-486a-b528-08dee966d4e1', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63902421-1e32-4cd6-899e-93d2fe9aab0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63902421-1e32-4cd6-899e-93d2fe9aab0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21cc4c5f-3643-4d5b-a3d3-37297ade8a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:57 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Volume 0662721b-b0ce-486a-b528-08dee966d4e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0662721b-b0ce-486a-b528-08dee966d4e1', 'volume_size': 1} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1983579970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0662721b-b0ce-486a-b528-08dee966d4e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc0572645884907b1a3c33932e35ff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:48:57Z,use_quota=True,user_id='fd743f8e19db4a36974872d1b76e2f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Creating volume 0662721b-b0ce-486a-b528-08dee966d4e1 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:48:57 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2d60ab50-274b-476f-9635-c1bed45d77a8" returned: 0 in 0.560s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "cinder-quobyte-2d60ab50-274b-476f-9635-c1bed45d77a8" released by "delete_volume" :: held 1.411s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:57 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 1073741824 Jul 24 15:48:57 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.quota [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Created reservations ['f63fb02e-f44f-4545-bb7e-cb0c21d73238', '379d299b-91b0-4f80-b37e-38acb0f5e4ed', '7204e6c2-4390-4e26-b2a8-e034dc950599', 'ad2db8b8-abbf-41b2-8580-762dc52958e6'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:57 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:48:57 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:57 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.329s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.manager [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:48:57 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Deleted volume successfully. Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-f65be04b-31c8-4a15-af4b-186f48627e14 req-48fad25c-c771-4dfa-a2a1-53f9c5ee77b3 tempest-VolumesSnapshotsTestJSON-1249643055 None] Lock "cinder-2d60ab50-274b-476f-9635-c1bed45d77a8-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:48:57 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 1073741824" returned: 0 in 0.782s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:48:58 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 Jul 24 15:48:58 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:48:58 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 24 15:48:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1" returned: 0 in 0.341s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:48:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:48:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:48:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21cc4c5f-3643-4d5b-a3d3-37297ade8a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0662721b-b0ce-486a-b528-08dee966d4e1', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d134ed5-1964-4b61-bb8f-be53e6b7c7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:48:58 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Volume volume-0662721b-b0ce-486a-b528-08dee966d4e1 (0662721b-b0ce-486a-b528-08dee966d4e1): created successfully Jul 24 15:48:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d134ed5-1964-4b61-bb8f-be53e6b7c7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:48:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Flow 'volume_create_manager' (9c5d093d-d0f5-4309-96ef-0423eeeb351d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:48:58 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-ea7268de-c6a1-4f50-9d04-bffc46435dc7 tempest-VolumesActionsTest-2084579446 None] Created volume successfully. Jul 24 15:49:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "cinder-75cf1b46-6b8b-4b78-adf9-590dccabb906-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "cinder-75cf1b46-6b8b-4b78-adf9-590dccabb906-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "cinder-quobyte-75cf1b46-6b8b-4b78-adf9-590dccabb906" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "cinder-quobyte-75cf1b46-6b8b-4b78-adf9-590dccabb906" acquired by "delete_volume" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:02 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a067a35c-8a65-4220-b3f0-f35b4702763e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-75cf1b46-6b8b-4b78-adf9-590dccabb906 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:02 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-75cf1b46-6b8b-4b78-adf9-590dccabb906 Jul 24 15:49:02 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:02 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-75cf1b46-6b8b-4b78-adf9-590dccabb906" returned: 0 in 0.495s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-75cf1b46-6b8b-4b78-adf9-590dccabb906 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:02 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-75cf1b46-6b8b-4b78-adf9-590dccabb906 Jul 24 15:49:02 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:02 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-75cf1b46-6b8b-4b78-adf9-590dccabb906" returned: 0 in 0.347s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "cinder-quobyte-75cf1b46-6b8b-4b78-adf9-590dccabb906" released by "delete_volume" :: held 0.919s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:03 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Created reservations ['6ef2c927-ae99-48ca-9da1-6dc17f5ca825', '70972a8e-025d-4711-b507-f0e733cb8fcf', '784fb79f-f393-48fc-b520-4babf7e379d8', '8589c178-445d-4a96-afe3-91d08bc9b34f'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:03 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:49:03 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:03 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.380s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:03 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:03 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Deleted volume successfully. Jul 24 15:49:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c2660b6c-d799-42cb-ba61-bb6a065773b2 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "cinder-75cf1b46-6b8b-4b78-adf9-590dccabb906-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "cinder-f977f67a-fbe0-43ce-a3e3-7181f28194ae-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "cinder-f977f67a-fbe0-43ce-a3e3-7181f28194ae-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "cinder-quobyte-f977f67a-fbe0-43ce-a3e3-7181f28194ae" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "cinder-quobyte-f977f67a-fbe0-43ce-a3e3-7181f28194ae" acquired by "delete_volume" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ca818d-562e-419e-bbd8-210414663ff5]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Flow 'volume_create_manager' (bc42ab2c-3d85-4939-8354-7e13a9c5a2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a0926c-43cc-4bb8-b84a-d3d3fe161ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:04 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae Jul 24 15:49:04 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a0926c-43cc-4bb8-b84a-d3d3fe161ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-843875400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d7006f-e222-4a14-90c4-68feb0ae1f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d1f02a58c64a1889a31e7590504d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:05Z,use_quota=True,user_id='5006ad103dfd42b093155ab7f8e80dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddfa087-71b1-42c8-b856-7809516ae24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ddfa087-71b1-42c8-b856-7809516ae24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1e4d1c-2e24-47cc-9bbd-57869c716ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c1e4d1c-2e24-47cc-9bbd-57869c716ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03d7006f-e222-4a14-90c4-68feb0ae1f61', 'volume_name': 'volume-03d7006f-e222-4a14-90c4-68feb0ae1f61', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3bcba5-fb5f-47cf-af63-6168addce7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3bcba5-fb5f-47cf-af63-6168addce7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8260b7-4490-478e-a033-790579a8be82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:04 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Volume 03d7006f-e222-4a14-90c4-68feb0ae1f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03d7006f-e222-4a14-90c4-68feb0ae1f61', 'volume_size': 1} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-843875400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03d7006f-e222-4a14-90c4-68feb0ae1f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46d1f02a58c64a1889a31e7590504d9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:05Z,use_quota=True,user_id='5006ad103dfd42b093155ab7f8e80dfb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Creating volume 03d7006f-e222-4a14-90c4-68feb0ae1f61 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:04 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:49:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-03d7006f-e222-4a14-90c4-68feb0ae1f61 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:05 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-03d7006f-e222-4a14-90c4-68feb0ae1f61 1073741824 Jul 24 15:49:05 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:05 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae" returned: 0 in 0.495s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:05 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae Jul 24 15:49:05 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:05 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-03d7006f-e222-4a14-90c4-68feb0ae1f61 1073741824" returned: 0 in 0.605s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:05 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f977f67a-fbe0-43ce-a3e3-7181f28194ae" returned: 0 in 0.341s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "cinder-quobyte-f977f67a-fbe0-43ce-a3e3-7181f28194ae" released by "delete_volume" :: held 0.900s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-03d7006f-e222-4a14-90c4-68feb0ae1f61 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:05 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-03d7006f-e222-4a14-90c4-68feb0ae1f61 Jul 24 15:49:05 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:05 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Created reservations ['23eb6502-2d5c-44d6-84f3-905e9d1521f7', '59e6e4c1-d343-4480-bb22-e507151cd03f', '19f63a74-254b-440a-98a3-65edee3e2bef', '0017f0db-5a0a-44b4-a2e7-39ceb56fb78b'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:05 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:49:05 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:06 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-03d7006f-e222-4a14-90c4-68feb0ae1f61" returned: 0 in 0.480s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8260b7-4490-478e-a033-790579a8be82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03d7006f-e222-4a14-90c4-68feb0ae1f61', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6378a11-7def-4f2c-b78e-0427474dc847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:06 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.361s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:06 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Deleted volume successfully. Jul 24 15:49:06 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Volume volume-03d7006f-e222-4a14-90c4-68feb0ae1f61 (03d7006f-e222-4a14-90c4-68feb0ae1f61): created successfully Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6378a11-7def-4f2c-b78e-0427474dc847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Flow 'volume_create_manager' (bc42ab2c-3d85-4939-8354-7e13a9c5a2e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "cinder-6497f924-07cf-4f75-b8b4-f0e8ec78e062-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-49fc6b69-93f7-489c-a1d8-4bf9e55ed808 tempest-AttachVolumeNegativeTest-1803157486 None] Lock "cinder-f977f67a-fbe0-43ce-a3e3-7181f28194ae-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:06 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-be48329c-a8d1-460e-a6b3-54bdd7062f57 tempest-AbsoluteLimitsTests-1415949738 None] Created volume successfully. Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Lock "cinder-6497f924-07cf-4f75-b8b4-f0e8ec78e062-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "cinder-quobyte-6497f924-07cf-4f75-b8b4-f0e8ec78e062" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Lock "cinder-quobyte-6497f924-07cf-4f75-b8b4-f0e8ec78e062" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1f992f-3ad6-4ddb-9d80-8b1d27f45324]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:06 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062 Jul 24 15:49:06 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:07 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062" returned: 0 in 0.868s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:07 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062 Jul 24 15:49:07 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Acquiring lock "cinder-03d7006f-e222-4a14-90c4-68feb0ae1f61-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Lock "cinder-03d7006f-e222-4a14-90c4-68feb0ae1f61-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Acquiring lock "cinder-quobyte-03d7006f-e222-4a14-90c4-68feb0ae1f61" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Lock "cinder-quobyte-03d7006f-e222-4a14-90c4-68feb0ae1f61" acquired by "delete_volume" :: waited 0.029s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:07 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed60f16a-6f08-45ac-81f9-98e16502c283]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-03d7006f-e222-4a14-90c4-68feb0ae1f61 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:07 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6497f924-07cf-4f75-b8b4-f0e8ec78e062" returned: 0 in 0.621s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:07 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-03d7006f-e222-4a14-90c4-68feb0ae1f61 Jul 24 15:49:07 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Lock "cinder-quobyte-6497f924-07cf-4f75-b8b4-f0e8ec78e062" released by "delete_volume" :: held 1.565s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:08 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Created reservations ['9f029c5d-110c-44f2-9377-e814f28b5f37', '83839a77-7701-495c-828a-207906b30eec', '47a5b430-6e86-48d2-8d82-8fece692a501', '9c46f699-b378-4816-b498-11d58601e830'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:08 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:49:08 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:08 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-03d7006f-e222-4a14-90c4-68feb0ae1f61" returned: 0 in 0.676s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-03d7006f-e222-4a14-90c4-68feb0ae1f61 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:08 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-03d7006f-e222-4a14-90c4-68feb0ae1f61 Jul 24 15:49:08 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:08 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.438s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:08 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:08 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Deleted volume successfully. Jul 24 15:49:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c92b5f60-bcf8-401c-8f64-62b89e5befcc tempest-AttachVolumeNegativeTest-1803157486 None] Lock "cinder-6497f924-07cf-4f75-b8b4-f0e8ec78e062-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:08 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-03d7006f-e222-4a14-90c4-68feb0ae1f61" returned: 0 in 0.417s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Lock "cinder-quobyte-03d7006f-e222-4a14-90c4-68feb0ae1f61" released by "delete_volume" :: held 1.202s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:08 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Created reservations ['bf8db868-3463-4157-b744-d1643a9b3836', '978844c1-c7fd-4704-b5ff-5131fac98614', 'cac30c6c-477b-40a6-badd-ada9cb94e920', '0f051b12-61b4-45d0-b3b1-bcd3f02c7587'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:09 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:49:09 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:09 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.475s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:09 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:09 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Deleted volume successfully. Jul 24 15:49:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9e25d759-24f2-47ae-a023-3ce18fd58471 tempest-AbsoluteLimitsTests-1415949738 None] Lock "cinder-03d7006f-e222-4a14-90c4-68feb0ae1f61-delete_volume" released by "delete_volume" :: held 2.079s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a5d7f9f6-30da-457b-987a-3daf18e55807 tempest-VolumesActionsTest-2084579446 None] Acquiring lock "cinder-0662721b-b0ce-486a-b528-08dee966d4e1" by "attach_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a5d7f9f6-30da-457b-987a-3daf18e55807 tempest-VolumesActionsTest-2084579446 None] Lock "cinder-0662721b-b0ce-486a-b528-08dee966d4e1" acquired by "attach_volume" :: waited 0.047s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:11 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a5d7f9f6-30da-457b-987a-3daf18e55807 tempest-VolumesActionsTest-2084579446 None] Attaching volume 0662721b-b0ce-486a-b528-08dee966d4e1 to instance f8af2abf-59cd-409d-930b-ce5f8b7e96d5 at mountpoint /dev/vdb on host None. Jul 24 15:49:11 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a5d7f9f6-30da-457b-987a-3daf18e55807 tempest-VolumesActionsTest-2084579446 None] Attach volume completed successfully. Jul 24 15:49:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a5d7f9f6-30da-457b-987a-3daf18e55807 tempest-VolumesActionsTest-2084579446 None] Lock "cinder-0662721b-b0ce-486a-b528-08dee966d4e1" released by "attach_volume" :: held 0.205s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-72bd02d5-480b-4dbf-91c6-e71201c27808 tempest-VolumesActionsTest-2084579446 None] Acquiring lock "cinder-0662721b-b0ce-486a-b528-08dee966d4e1-detach_volume" by "detach_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-72bd02d5-480b-4dbf-91c6-e71201c27808 tempest-VolumesActionsTest-2084579446 None] Lock "cinder-0662721b-b0ce-486a-b528-08dee966d4e1-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:11 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-72bd02d5-480b-4dbf-91c6-e71201c27808 tempest-VolumesActionsTest-2084579446 None] Detaching volume 0662721b-b0ce-486a-b528-08dee966d4e1 from instance f8af2abf-59cd-409d-930b-ce5f8b7e96d5. Jul 24 15:49:11 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-72bd02d5-480b-4dbf-91c6-e71201c27808 tempest-VolumesActionsTest-2084579446 None] Detach volume completed successfully. Jul 24 15:49:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-72bd02d5-480b-4dbf-91c6-e71201c27808 tempest-VolumesActionsTest-2084579446 None] Lock "cinder-0662721b-b0ce-486a-b528-08dee966d4e1-detach_volume" released by "detach_volume" :: held 0.118s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:12 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-17b4c6b8-c0de-4dda-9d55-c7f95f9bd248 tempest-GroupSnapshotsTest-1707603888 None] Group tempest-GroupSnapshotsTest-Group-1211275396: creating Jul 24 15:49:12 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-17b4c6b8-c0de-4dda-9d55-c7f95f9bd248 tempest-GroupSnapshotsTest-1707603888 None] Group tempest-GroupSnapshotsTest-Group-1211275396: created successfully Jul 24 15:49:12 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-17b4c6b8-c0de-4dda-9d55-c7f95f9bd248 tempest-GroupSnapshotsTest-1707603888 None] Create group completed successfully. Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Flow 'volume_create_manager' (e84a3288-1d26-4e08-bcad-a6c1a0b91794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2b58a4-65de-483b-93c6-178d912cd754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad2b58a4-65de-483b-93c6-178d912cd754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2004065846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e749c003-e522-4b61-b974-b82fc3062bbe,host='devstack@QuobyteHD#QuobyteHD',id=cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc2a01e12564792a3ed38ec923b65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:15Z,use_quota=True,user_id='be830decee614d7c86e5477fb5da5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f18fc0-d67f-4861-a181-a848fc906f5b),volume_type_id=00f18fc0-d67f-4861-a181-a848fc906f5b)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757bc2fd-f113-43dc-baaf-2669ae87968d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757bc2fd-f113-43dc-baaf-2669ae87968d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a45c28e-01d9-4ef1-ad8c-07b484c74624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a45c28e-01d9-4ef1-ad8c-07b484c74624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85', 'volume_name': 'volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fbe86f-d2d2-43b2-8d49-0b38447dfcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54fbe86f-d2d2-43b2-8d49-0b38447dfcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b2e3eb0-2c1a-4df3-9171-76a0156b9327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:14 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Volume cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85', 'volume_size': 1} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e749c003-e522-4b61-b974-b82fc3062bbe,created_at=2026-07-24T13:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2004065846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e749c003-e522-4b61-b974-b82fc3062bbe,host='devstack@QuobyteHD#QuobyteHD',id=cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc2a01e12564792a3ed38ec923b65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:15Z,use_quota=True,user_id='be830decee614d7c86e5477fb5da5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00f18fc0-d67f-4861-a181-a848fc906f5b),volume_type_id=00f18fc0-d67f-4861-a181-a848fc906f5b)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Creating volume cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:14 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:49:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:14 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 1073741824 Jul 24 15:49:14 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:15 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 1073741824" returned: 0 in 0.648s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:15 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 Jul 24 15:49:15 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:15 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85" returned: 0 in 0.349s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:49:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b2e3eb0-2c1a-4df3-9171-76a0156b9327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4128f366-d87c-4f73-822b-5f750f541b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:16 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Volume volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 (cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85): created successfully Jul 24 15:49:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4128f366-d87c-4f73-822b-5f750f541b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Flow 'volume_create_manager' (e84a3288-1d26-4e08-bcad-a6c1a0b91794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:16 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-cd0fae6f-ebe8-41dd-b0e2-27897174a3f2 tempest-GroupSnapshotsTest-1707603888 None] Created volume successfully. Jul 24 15:49:17 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] GroupSnapshot e6319704-a97c-435e-a511-903982f6ff33: creating. Jul 24 15:49:17 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=102,cinder:UPDATE=120,cinder:INSERT=26,cinder:DELETE=9 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:49:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] Group snapshot e6319704-a97c-435e-a511-903982f6ff33: creating. {{(pid=88350) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 15:49:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] Creating offline snapshot ff1f395d-a615-4ca1-88d4-af759b84e695 of volume cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:49:17 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7f29e8-9ec1-4f77-b968-19293401f546]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:17 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 Jul 24 15:49:17 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Flow 'volume_create_manager' (088369d4-10f9-4237-bf15-ead9f8f6578f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf47254-e115-4cf8-b798-4842b8f8a06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf47254-e115-4cf8-b798-4842b8f8a06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1745612536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f59a58e-ff89-4140-bece-fe8a1c9416f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba87cf577a24258bbe238db639fe7fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:18Z,use_quota=True,user_id='69eaf4df19d348c49aaab9197c84d3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc13b13-2899-490e-b8b9-49ee22258a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc13b13-2899-490e-b8b9-49ee22258a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa9fed2-ae33-43ea-b682-dd02fd9a8a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa9fed2-ae33-43ea-b682-dd02fd9a8a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f59a58e-ff89-4140-bece-fe8a1c9416f6', 'volume_name': 'volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (723af5f1-6911-486b-bafa-1667d07f0104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (723af5f1-6911-486b-bafa-1667d07f0104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab50ce5f-7ced-449d-8b86-59d7975fadcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:18 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Volume 2f59a58e-ff89-4140-bece-fe8a1c9416f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6', 'volume_size': 1} Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:18 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85" returned: 0 in 0.536s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:18 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 1G Jul 24 15:49:18 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:18 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 1G" returned: 0 in 0.546s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:18 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 Jul 24 15:49:18 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:19 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695" returned: 0 in 0.387s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:19 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:49:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:19 devstack sudo[97925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 Jul 24 15:49:19 devstack sudo[97925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:19 devstack sudo[97925]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695" returned: 0 in 0.342s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:19 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.info Jul 24 15:49:19 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:20 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.info" returned: 0 in 0.475s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:20 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:20 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.info Jul 24 15:49:20 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a08fc0a9-e900-4e2c-bf91-588cc991c347 tempest-BackendsCapabilitiesAdminTestsJSON-1456341186 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88350) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-58992500-1d79-43a3-8487-711faaceeb93 tempest-BackendsCapabilitiesAdminTestsJSON-1456341186 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88350) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 24 15:49:20 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.info" returned: 0 in 0.258s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.678s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.297s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1745612536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f59a58e-ff89-4140-bece-fe8a1c9416f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba87cf577a24258bbe238db639fe7fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:18Z,use_quota=True,user_id='69eaf4df19d348c49aaab9197c84d3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Creating volume 2f59a58e-ff89-4140-bece-fe8a1c9416f6 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:20 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:49:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:20 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 1073741824 Jul 24 15:49:20 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:20 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-aa4b6ecc-056c-49e9-a09e-acd175fdd9c0 tempest-GroupSnapshotsTest-1707603888 None] group_snapshot e6319704-a97c-435e-a511-903982f6ff33: created successfully Jul 24 15:49:21 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 1073741824" returned: 0 in 0.557s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:21 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 Jul 24 15:49:21 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:21 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6" returned: 0 in 0.376s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:49:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab50ce5f-7ced-449d-8b86-59d7975fadcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d86886d-a274-4e43-9043-f0af41e60329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:21 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Volume volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 (2f59a58e-ff89-4140-bece-fe8a1c9416f6): created successfully Jul 24 15:49:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d86886d-a274-4e43-9043-f0af41e60329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Flow 'volume_create_manager' (088369d4-10f9-4237-bf15-ead9f8f6578f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:21 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-8f0908fb-d65c-49f9-8089-d7b039986496 tempest-VolumesCloneTest-883515067 None] Created volume successfully. Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "cinder-quobyte-ff1f395d-a615-4ca1-88d4-af759b84e695-49a0583c-8a94-41c2-8510-c80c6e1268ec" by "_create_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-ff1f395d-a615-4ca1-88d4-af759b84e695-49a0583c-8a94-41c2-8510-c80c6e1268ec" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Creating volume 49a0583c-8a94-41c2-8510-c80c6e1268ec from snapshot ff1f395d-a615-4ca1-88d4-af759b84e695 {{(pid=88350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "cinder-quobyte-49a0583c-8a94-41c2-8510-c80c6e1268ec" by "_copy_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-49a0583c-8a94-41c2-8510-c80c6e1268ec" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] snapshot: ff1f395d-a615-4ca1-88d4-af759b84e695, volume: 49a0583c-8a94-41c2-8510-c80c6e1268ec, {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2b84ba-17c7-4081-bafa-ef5700944daf]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:22 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 Jul 24 15:49:22 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:23 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695" returned: 0 in 1.051s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:49:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:49:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Creating direct copy from snapshot {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:49:23 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c689c6-f7fc-4b7c-91a1-4f6c6cf44e0d]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:23 devstack sudo[98006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 Jul 24 15:49:23 devstack sudo[98006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:23 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Flow 'volume_create_manager' (5bcf5734-7e7e-4071-bdd6-50f8dcf9604c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1277f3ac-4c21-45be-990b-3c26ff539069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1277f3ac-4c21-45be-990b-3c26ff539069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1192493538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=447c36a6-1743-4002-9c23-ad233c86fa57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba87cf577a24258bbe238db639fe7fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2f59a58e-ff89-4140-bece-fe8a1c9416f6,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:24Z,use_quota=True,user_id='69eaf4df19d348c49aaab9197c84d3e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b98316-58aa-402d-a2ae-66971376bcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b98316-58aa-402d-a2ae-66971376bcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597cfdb7-a802-40d8-8942-056aed4388b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597cfdb7-a802-40d8-8942-056aed4388b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '447c36a6-1743-4002-9c23-ad233c86fa57', 'volume_name': 'volume-447c36a6-1743-4002-9c23-ad233c86fa57', 'volume_size': 2, 'source_volid': '2f59a58e-ff89-4140-bece-fe8a1c9416f6', 'source_volstatus': 'available'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c02e815-f92b-4819-988c-bed8af823e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c02e815-f92b-4819-988c-bed8af823e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f89d171-f155-4dc6-83ae-1b4d1f627c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:24 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Volume 447c36a6-1743-4002-9c23-ad233c86fa57: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-447c36a6-1743-4002-9c23-ad233c86fa57', 'volume_size': 2, 'source_volid': '2f59a58e-ff89-4140-bece-fe8a1c9416f6', 'source_volstatus': 'available'} Jul 24 15:49:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:24 devstack sudo[98006]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85" returned: 0 in 0.796s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:24 devstack cinder-volume[88350]: DEBUG cinder.utils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Path /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49a0583c-8a94-41c2-8510-c80c6e1268ec not found in is_blk_device check {{(pid=88350) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:49:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49a0583c-8a94-41c2-8510-c80c6e1268ec {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:24 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49a0583c-8a94-41c2-8510-c80c6e1268ec Jul 24 15:49:24 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:29 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a9b731f6-2dda-4d3c-80df-b1e559af0fbb tempest-VolumesActionsTest-2084579446 None] Acquiring lock "cinder-0662721b-b0ce-486a-b528-08dee966d4e1" by "attach_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:29 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a9b731f6-2dda-4d3c-80df-b1e559af0fbb tempest-VolumesActionsTest-2084579446 None] Lock "cinder-0662721b-b0ce-486a-b528-08dee966d4e1" acquired by "attach_volume" :: waited 0.051s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:29 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a9b731f6-2dda-4d3c-80df-b1e559af0fbb tempest-VolumesActionsTest-2084579446 None] Attaching volume 0662721b-b0ce-486a-b528-08dee966d4e1 to instance 3918429d-22cf-4bda-81f9-07848a2891a0 at mountpoint /dev/vdb on host None. Jul 24 15:49:29 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a9b731f6-2dda-4d3c-80df-b1e559af0fbb tempest-VolumesActionsTest-2084579446 None] Attach volume completed successfully. Jul 24 15:49:29 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a9b731f6-2dda-4d3c-80df-b1e559af0fbb tempest-VolumesActionsTest-2084579446 None] Lock "cinder-0662721b-b0ce-486a-b528-08dee966d4e1" released by "attach_volume" :: held 0.356s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9c39abc4-7f81-4056-bcd9-8bbb38a92c50 tempest-VolumesActionsTest-2084579446 None] Acquiring lock "cinder-0662721b-b0ce-486a-b528-08dee966d4e1-detach_volume" by "detach_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9c39abc4-7f81-4056-bcd9-8bbb38a92c50 tempest-VolumesActionsTest-2084579446 None] Lock "cinder-0662721b-b0ce-486a-b528-08dee966d4e1-detach_volume" acquired by "detach_volume" :: waited 0.073s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:30 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-9c39abc4-7f81-4056-bcd9-8bbb38a92c50 tempest-VolumesActionsTest-2084579446 None] Detaching volume 0662721b-b0ce-486a-b528-08dee966d4e1 from instance 3918429d-22cf-4bda-81f9-07848a2891a0. Jul 24 15:49:30 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-9c39abc4-7f81-4056-bcd9-8bbb38a92c50 tempest-VolumesActionsTest-2084579446 None] Detach volume completed successfully. Jul 24 15:49:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9c39abc4-7f81-4056-bcd9-8bbb38a92c50 tempest-VolumesActionsTest-2084579446 None] Lock "cinder-0662721b-b0ce-486a-b528-08dee966d4e1-detach_volume" released by "detach_volume" :: held 0.202s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:31 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49a0583c-8a94-41c2-8510-c80c6e1268ec" returned: 0 in 7.675s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:31 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa88c8d-1289-4c17-ada3-e0d615a6cc40]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:31 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 Jul 24 15:49:31 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:32 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85" returned: 0 in 0.896s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:32 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Image conversion details: src /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85, size 1024.00 MB, duration 7.68 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49a0583c-8a94-41c2-8510-c80c6e1268ec {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:49:32 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Converted 1024.00 MB image at 133.38 MB/s Jul 24 15:49:32 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49a0583c-8a94-41c2-8510-c80c6e1268ec is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:49:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49a0583c-8a94-41c2-8510-c80c6e1268ec {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:32 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49a0583c-8a94-41c2-8510-c80c6e1268ec Jul 24 15:49:32 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:33 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49a0583c-8a94-41c2-8510-c80c6e1268ec" returned: 0 in 0.310s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-49a0583c-8a94-41c2-8510-c80c6e1268ec" released by "_copy_volume_from_snapshot" :: held 10.948s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-ff1f395d-a615-4ca1-88d4-af759b84e695-49a0583c-8a94-41c2-8510-c80c6e1268ec" released by "_create_volume_from_snapshot" :: held 11.001s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.037s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.020s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:33 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Cloning volume 2f59a58e-ff89-4140-bece-fe8a1c9416f6 to volume 447c36a6-1743-4002-9c23-ad233c86fa57 Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Creating offline snapshot 191c216a-9380-4915-91be-ff40a2a11de2 of volume 2f59a58e-ff89-4140-bece-fe8a1c9416f6 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a161d1b-aeed-4552-89f5-6953b6b2b206]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:33 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-bb535de4-8055-478c-9498-ad57edae7c81 tempest-GroupSnapshotsTest-1707603888 None] Create group from source-snapshot-e6319704-a97c-435e-a511-903982f6ff33 completed successfully. Jul 24 15:49:33 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 Jul 24 15:49:33 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Flow 'volume_create_manager' (88292291-0295-4553-a3d5-890fb0ae0476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d5a176-f549-4460-96b1-b41ef0002c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d5a176-f549-4460-96b1-b41ef0002c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-495520074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1a600c1dc0496fae2df4635ab5043d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:33Z,use_quota=True,user_id='ae17fc17d30244afb2adc99e12e2a8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2486ffa8-8115-4ba2-93c9-f326f0f92709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2486ffa8-8115-4ba2-93c9-f326f0f92709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011296fb-b011-4dbe-aa27-5286151f2d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011296fb-b011-4dbe-aa27-5286151f2d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1', 'volume_name': 'volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac912c92-23d6-4c7d-acf1-1730d67d295e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac912c92-23d6-4c7d-acf1-1730d67d295e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b81c410-3d4c-42a0-b652-5d22949807a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:33 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Volume 7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1', 'volume_size': 1} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:33 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6" returned: 0 in 0.602s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:33 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 1G Jul 24 15:49:33 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "cinder-quobyte-49a0583c-8a94-41c2-8510-c80c6e1268ec" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-49a0583c-8a94-41c2-8510-c80c6e1268ec" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:34 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b981f081-2b43-49cf-b8af-e4caa0d651d1]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49a0583c-8a94-41c2-8510-c80c6e1268ec {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:34 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 1G" returned: 0 in 0.506s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:34 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 Jul 24 15:49:34 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:34 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49a0583c-8a94-41c2-8510-c80c6e1268ec Jul 24 15:49:34 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:34 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49a0583c-8a94-41c2-8510-c80c6e1268ec" returned: 0 in 0.414s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49a0583c-8a94-41c2-8510-c80c6e1268ec {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:34 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:34 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49a0583c-8a94-41c2-8510-c80c6e1268ec Jul 24 15:49:34 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2" returned: 0 in 0.400s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:34 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 is being set with open permissions: ugo+rw Jul 24 15:49:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:34 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 Jul 24 15:49:34 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:34 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49a0583c-8a94-41c2-8510-c80c6e1268ec" returned: 0 in 0.278s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-49a0583c-8a94-41c2-8510-c80c6e1268ec" released by "delete_volume" :: held 0.740s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:34 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2" returned: 0 in 0.281s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:35 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.info Jul 24 15:49:35 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Created reservations ['13fc5a93-2dfc-4494-ac7b-4660b197a159'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:35 devstack cinder-volume[88350]: WARNING cinder.quota [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1601628049 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1601628049, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:49:35 devstack cinder-volume[88350]: WARNING cinder.quota [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1601628049 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1601628049, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Created reservations ['f0268a2c-638c-4c3c-89e2-1c5bd9cb010e', 'e9fb4d80-f64b-41a3-99c9-cf5c570063df', '926c0127-1514-4bcf-925d-7f827d47133a', 'c6540b90-5c2a-4c1e-b8cf-a378fb06f6be'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:35 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:49:35 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:35 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.info" returned: 0 in 0.287s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:35 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.info is being set with open permissions: ugo+rw Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:35 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.info Jul 24 15:49:35 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:35 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.273s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:35 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-775ebf3c-d335-4298-8b02-95d610b2cd47 tempest-GroupSnapshotsTest-1707603888 None] Delete group completed successfully. Jul 24 15:49:35 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.info" returned: 0 in 0.261s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Acquiring lock "cinder-quobyte-447c36a6-1743-4002-9c23-ad233c86fa57" by "_copy_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:35 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] group_snapshot e6319704-a97c-435e-a511-903982f6ff33: deleting Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Lock "cinder-quobyte-447c36a6-1743-4002-9c23-ad233c86fa57" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] snapshot: 191c216a-9380-4915-91be-ff40a2a11de2, volume: 447c36a6-1743-4002-9c23-ad233c86fa57, {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] group_snapshot e6319704-a97c-435e-a511-903982f6ff33: deleting {{(pid=88350) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee83d7fe-6d22-4ca7-8537-aa3873d0da39]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "cinder-quobyte-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "cinder-quobyte-ff1f395d-a615-4ca1-88d4-af759b84e695" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-ff1f395d-a615-4ca1-88d4-af759b84e695" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] Deleting offline snapshot ff1f395d-a615-4ca1-88d4-af759b84e695 of volume cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] snapshot_file for this snap is: volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:49:35 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 Jul 24 15:49:35 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3cbeb4-e554-417e-8bf3-38ae359ff42d]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:35 devstack sudo[98154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 Jul 24 15:49:35 devstack sudo[98154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:36 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2" returned: 0 in 0.428s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Creating direct copy from snapshot {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4704e32-e435-4aed-81a7-6a511ff8f95f]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:36 devstack sudo[98154]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695" returned: 0 in 0.419s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:49:36 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 Jul 24 15:49:36 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7f857b-51ba-4764-9a1c-000f65fced70]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:36 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 Jul 24 15:49:36 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:36 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6" returned: 0 in 0.404s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG cinder.utils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Path /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-447c36a6-1743-4002-9c23-ad233c86fa57 not found in is_blk_device check {{(pid=88350) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-447c36a6-1743-4002-9c23-ad233c86fa57 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:36 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-447c36a6-1743-4002-9c23-ad233c86fa57 Jul 24 15:49:36 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:36 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85" returned: 0 in 0.407s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:36 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 Jul 24 15:49:36 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:37 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695" returned: 0 in 0.551s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:37 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695 Jul 24 15:49:37 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:37 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85.ff1f395d-a615-4ca1-88d4-af759b84e695" returned: 0 in 0.474s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-ff1f395d-a615-4ca1-88d4-af759b84e695" released by "_delete_snapshot" :: held 2.017s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85" released by "delete_snapshot" :: held 2.071s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:38 devstack cinder-volume[88350]: WARNING cinder.quota [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1601628049 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1601628049, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:49:38 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] Created reservations ['75094936-b126-4f90-9758-7d31a0a5bdbc', '7b7c1af6-df7f-4b14-a51d-1d9881c21c9e', '0ab7925d-041e-4b25-8250-6e48b01d9d5d', '78978686-ed7d-4228-a04f-dbb06ad839ec'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:38 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a864420a-ecc3-4aab-9676-d865f03758a0 tempest-GroupSnapshotsTest-1707603888 None] group_snapshot e6319704-a97c-435e-a511-903982f6ff33: deleted successfully Jul 24 15:49:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "cinder-quobyte-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85" acquired by "delete_volume" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:39 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5214bd5c-f5fc-4998-ad2e-3734533e5ad6]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:49:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:40 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:49:40 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:40 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 Jul 24 15:49:40 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:40 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.598s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:49:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:49:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:49:40 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85" returned: 0 in 0.966s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:40 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85 Jul 24 15:49:40 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:41 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-447c36a6-1743-4002-9c23-ad233c86fa57" returned: 0 in 4.815s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[26053cf7-f4f3-498a-9b6f-5203565da732]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:41 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85" returned: 0 in 0.577s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-cb2dfecb-66ca-4ab5-b2bc-6cd6202acd85" released by "delete_volume" :: held 1.668s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Created reservations ['91a8f3f6-dc8e-4ae3-a00c-6f347e07980a'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:41 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 Jul 24 15:49:41 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:41 devstack cinder-volume[88350]: WARNING cinder.db.api [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1601628049'] Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Created reservations ['6af2a295-40a3-4fd9-a201-7a725336787e', 'd6292ee2-21a8-4a68-a9ed-75c3fb864c41', 'bedee920-4235-4fcb-bd32-85a7acb4a944', 'cb9c4993-c00d-4215-aeb8-a0f81a9cc4cd'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:41 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:49:41 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:41 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.242s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:41 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-ac04f1e4-56ef-4ccc-8eb8-08f41c7af486 tempest-GroupSnapshotsTest-1707603888 None] Delete group completed successfully. Jul 24 15:49:41 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6" returned: 0 in 0.539s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Image conversion details: src /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6, size 1024.00 MB, duration 4.82 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-447c36a6-1743-4002-9c23-ad233c86fa57 {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:49:41 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Converted 1024.00 MB image at 212.56 MB/s Jul 24 15:49:41 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-447c36a6-1743-4002-9c23-ad233c86fa57 is being set with open permissions: ugo+rw Jul 24 15:49:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-447c36a6-1743-4002-9c23-ad233c86fa57 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:41 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-447c36a6-1743-4002-9c23-ad233c86fa57 Jul 24 15:49:41 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:42 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-447c36a6-1743-4002-9c23-ad233c86fa57" returned: 0 in 0.256s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Lock "cinder-quobyte-447c36a6-1743-4002-9c23-ad233c86fa57" released by "_copy_volume_from_snapshot" :: held 6.548s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Acquiring lock "cinder-quobyte-191c216a-9380-4915-91be-ff40a2a11de2" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Lock "cinder-quobyte-191c216a-9380-4915-91be-ff40a2a11de2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Deleting offline snapshot 191c216a-9380-4915-91be-ff40a2a11de2 of volume 2f59a58e-ff89-4140-bece-fe8a1c9416f6 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:49:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] snapshot_file for this snap is: volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:49:42 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d190548d-c2a4-4345-a7f3-51bb334ba98d]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:42 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 Jul 24 15:49:42 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:42 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2" returned: 0 in 0.386s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:49:42 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7c95a2-16e3-47a7-a9fe-fcece1a0c80b]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:42 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 Jul 24 15:49:42 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:42 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3d83b683-6ae7-410d-8ca2-f693081bc8c9 tempest-GroupSnapshotsTest-1707603888 None] Group tempest-GroupSnapshotsTest-Group-834806915: creating Jul 24 15:49:42 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3d83b683-6ae7-410d-8ca2-f693081bc8c9 tempest-GroupSnapshotsTest-1707603888 None] Group tempest-GroupSnapshotsTest-Group-834806915: created successfully Jul 24 15:49:42 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3d83b683-6ae7-410d-8ca2-f693081bc8c9 tempest-GroupSnapshotsTest-1707603888 None] Create group completed successfully. Jul 24 15:49:43 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6" returned: 0 in 0.385s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:43 devstack sudo[98229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 Jul 24 15:49:43 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:43 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2" returned: 0 in 0.340s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:43 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2 Jul 24 15:49:43 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:43 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6.191c216a-9380-4915-91be-ff40a2a11de2" returned: 0 in 0.253s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Lock "cinder-quobyte-191c216a-9380-4915-91be-ff40a2a11de2" released by "_delete_snapshot" :: held 1.461s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.664s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.137s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-495520074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe1a600c1dc0496fae2df4635ab5043d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:33Z,use_quota=True,user_id='ae17fc17d30244afb2adc99e12e2a8b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Creating volume 7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:49:43 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f89d171-f155-4dc6-83ae-1b4d1f627c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-447c36a6-1743-4002-9c23-ad233c86fa57', 'volume_size': 2, 'source_volid': '2f59a58e-ff89-4140-bece-fe8a1c9416f6', 'source_volstatus': 'available'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:43 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 1073741824 Jul 24 15:49:43 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b43f842-e181-4734-9151-23d27e777d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:43 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Volume volume-447c36a6-1743-4002-9c23-ad233c86fa57 (447c36a6-1743-4002-9c23-ad233c86fa57): created successfully Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b43f842-e181-4734-9151-23d27e777d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:43 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Flow 'volume_create_manager' (5bcf5734-7e7e-4071-bdd6-50f8dcf9604c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:43 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-22a39598-027d-488f-adf5-1c59ed1d166b tempest-VolumesCloneTest-883515067 None] Created volume successfully. Jul 24 15:49:44 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 1073741824" returned: 0 in 0.529s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:44 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 Jul 24 15:49:44 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:44 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" returned: 0 in 0.311s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 8.143s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c941ca2c-0570-4623-b8cc-9edaa58333c4]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b81c410-3d4c-42a0-b652-5d22949807a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ebdda5-45a8-45f7-afed-6eb9911e3c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Flow 'volume_create_manager' (64d0546e-e617-4267-8108-e7dfa651d34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad905f4e-bc80-4e0d-af45-8521f1c82047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Acquiring lock "cinder-447c36a6-1743-4002-9c23-ad233c86fa57-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:44 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Volume volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 (7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1): created successfully Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02ebdda5-45a8-45f7-afed-6eb9911e3c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Flow 'volume_create_manager' (88292291-0295-4553-a3d5-890fb0ae0476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Lock "cinder-447c36a6-1743-4002-9c23-ad233c86fa57-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:44 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 Jul 24 15:49:44 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad905f4e-bc80-4e0d-af45-8521f1c82047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-388627121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2759e96-6301-498b-b4b0-998b9f9ccc20,host='devstack@QuobyteHD#QuobyteHD',id=7f051c26-414b-4a4c-a7db-cb832392f84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc2a01e12564792a3ed38ec923b65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:45Z,use_quota=True,user_id='be830decee614d7c86e5477fb5da5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a00448b0-dbc6-46d4-8d99-2b5fca33e362),volume_type_id=a00448b0-dbc6-46d4-8d99-2b5fca33e362)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7c8319-f85b-4e94-856b-d5b31fd8504d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb7c8319-f85b-4e94-856b-d5b31fd8504d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0a20d6-00c9-4b31-a6b8-c0b49f3ce1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0a20d6-00c9-4b31-a6b8-c0b49f3ce1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f051c26-414b-4a4c-a7db-cb832392f84e', 'volume_name': 'volume-7f051c26-414b-4a4c-a7db-cb832392f84e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c80813c-6960-44d8-8cd4-21abc08e1b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c80813c-6960-44d8-8cd4-21abc08e1b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ef81b4-6cfc-4db9-be9c-0cd21211f106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:44 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Volume 7f051c26-414b-4a4c-a7db-cb832392f84e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f051c26-414b-4a4c-a7db-cb832392f84e', 'volume_size': 1} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:44 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-8b6f9e7c-6f87-4626-92c8-25a1c7cddb3a tempest-SnapshotsActionsTest-506912227 None] Created volume successfully. Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Acquiring lock "cinder-quobyte-447c36a6-1743-4002-9c23-ad233c86fa57" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Lock "cinder-quobyte-447c36a6-1743-4002-9c23-ad233c86fa57" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e99fb4-ac80-4117-ae52-0131dd53fb8b]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-447c36a6-1743-4002-9c23-ad233c86fa57 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:45 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1" returned: 0 in 0.395s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1512efb7-1f1b-470f-aa26-ab9e6095b2be]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:45 devstack sudo[98247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-447c36a6-1743-4002-9c23-ad233c86fa57 Jul 24 15:49:45 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:45 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 Jul 24 15:49:45 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:45 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-447c36a6-1743-4002-9c23-ad233c86fa57" returned: 0 in 0.380s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-447c36a6-1743-4002-9c23-ad233c86fa57 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:45 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-447c36a6-1743-4002-9c23-ad233c86fa57 Jul 24 15:49:45 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:45 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1" returned: 0 in 0.371s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.8f453136-9f0d-4420-b73c-b03840585bce03r77hix.img {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:45 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.8f453136-9f0d-4420-b73c-b03840585bce03r77hix.img Jul 24 15:49:45 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:45 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-447c36a6-1743-4002-9c23-ad233c86fa57" returned: 0 in 0.256s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Lock "cinder-quobyte-447c36a6-1743-4002-9c23-ad233c86fa57" released by "delete_volume" :: held 0.688s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Created reservations ['3832acae-1aac-4902-9a21-3083da1d4e02', 'a57daf7d-c48c-4805-98b1-73eed931ebdb', '9be84fb7-06c9-49da-b9c5-1ceac3b87e1f', '531b4016-d812-464c-8962-0f85a6065753'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:45 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:49:45 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:46 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Acquiring lock "cinder-2f59a58e-ff89-4140-bece-fe8a1c9416f6-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.692s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:46 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:46 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Deleted volume successfully. Jul 24 15:49:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Lock "cinder-2f59a58e-ff89-4140-bece-fe8a1c9416f6-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-53a33d46-673b-489b-a66a-986e34013be8 tempest-VolumesCloneTest-883515067 None] Lock "cinder-447c36a6-1743-4002-9c23-ad233c86fa57-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Acquiring lock "cinder-quobyte-2f59a58e-ff89-4140-bece-fe8a1c9416f6" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:49:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Lock "cinder-quobyte-2f59a58e-ff89-4140-bece-fe8a1c9416f6" acquired by "delete_volume" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:49:46 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d66f1a-d1af-49ef-b163-4404759cc4e3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:47 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 Jul 24 15:49:47 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:47 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6" returned: 0 in 0.890s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:47 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6 Jul 24 15:49:47 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:48 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f59a58e-ff89-4140-bece-fe8a1c9416f6" returned: 0 in 0.511s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:48 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Lock "cinder-quobyte-2f59a58e-ff89-4140-bece-fe8a1c9416f6" released by "delete_volume" :: held 1.570s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:48 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Created reservations ['53b6daac-037c-4981-91c9-77e1b4833c79', '62246801-e9d3-446f-81a1-08ae4ad787ae', '76782e53-9852-4d34-8010-531d01cbd775', '201b6860-9a00-4428-bd60-577848484299'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:49:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:49:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:49:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:49:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:49:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:49:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:48 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:49:48 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:48 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.513s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:49 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:49:49 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Deleted volume successfully. Jul 24 15:49:49 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cd0750bf-6937-41da-ba73-50a7346c0885 tempest-VolumesCloneTest-883515067 None] Lock "cinder-2f59a58e-ff89-4140-bece-fe8a1c9416f6-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:49:50 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.8f453136-9f0d-4420-b73c-b03840585bce03r77hix.img" returned: 0 in 4.930s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:50 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cdb491-2b41-4332-8d73-f817a5d1df74]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:49:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:49:50 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 Jul 24 15:49:50 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:49:50 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Jul 24 15:49:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1" returned: 0 in 0.524s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:49:50 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] Image conversion details: src /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1, size 1024.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.8f453136-9f0d-4420-b73c-b03840585bce03r77hix.img {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:49:50 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] Converted 1024.00 MB image at 207.67 MB/s Jul 24 15:49:50 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] 8f453136-9f0d-4420-b73c-b03840585bce was raw, no need to convert to raw {{(pid=88350) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 24 15:49:53 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=130,cinder:SELECT=117,cinder:INSERT=35,cinder:DELETE=8 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:49:53 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:49:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Flow 'volume_create_manager' (e74fa985-31b1-4e68-9a62-0415af3fe9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:49:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bd4b22-4d9e-4200-9cb4-813ecaa8f1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40bd4b22-4d9e-4200-9cb4-813ecaa8f1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1674342880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68147cb2-6222-4ed5-9a07-1cfef2ebc28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddab9a393987424b8c1de0a88729f93f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:53Z,use_quota=True,user_id='1ee4321cbd394e0089da889ef87f6eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5940c8f-c74c-487d-9529-4df49f1db38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5940c8f-c74c-487d-9529-4df49f1db38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9646cbbb-9ee6-48e6-962d-2327238befa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9646cbbb-9ee6-48e6-962d-2327238befa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68147cb2-6222-4ed5-9a07-1cfef2ebc28d', 'volume_name': 'volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d', 'volume_size': 2}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea685974-83b9-445a-b3de-a06d8ed0f3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea685974-83b9-445a-b3de-a06d8ed0f3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:49:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf98b2a-918c-4a58-989c-9439784a597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:49:53 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Volume 68147cb2-6222-4ed5-9a07-1cfef2ebc28d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d', 'volume_size': 2} Jul 24 15:49:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:03 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=66,cinder:UPDATE=57,cinder:INSERT=13,cinder:DELETE=2 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:50:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.251s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] Uploaded volume to glance image-id: 8f453136-9f0d-4420-b73c-b03840585bce. {{(pid=88350) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 24 15:50:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.032s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2759e96-6301-498b-b4b0-998b9f9ccc20,created_at=2026-07-24T13:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-388627121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2759e96-6301-498b-b4b0-998b9f9ccc20,host='devstack@QuobyteHD#QuobyteHD',id=7f051c26-414b-4a4c-a7db-cb832392f84e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc2a01e12564792a3ed38ec923b65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:45Z,use_quota=True,user_id='be830decee614d7c86e5477fb5da5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a00448b0-dbc6-46d4-8d99-2b5fca33e362),volume_type_id=a00448b0-dbc6-46d4-8d99-2b5fca33e362)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Creating volume 7f051c26-414b-4a4c-a7db-cb832392f84e {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:09 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:50:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:09 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e 1073741824 Jul 24 15:50:09 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:09 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2c8fbfae-8317-4d86-976a-90337a074b24 tempest-VolumesActionsTest-2084579446 None] Copy volume to image completed successfully. Jul 24 15:50:10 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e 1073741824" returned: 0 in 0.506s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:10 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e Jul 24 15:50:10 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:10 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e" returned: 0 in 0.267s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 24.174s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ef81b4-6cfc-4db9-be9c-0cd21211f106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f051c26-414b-4a4c-a7db-cb832392f84e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a10a33-10d8-4452-9db3-b406c8526d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] Creating offline snapshot 59cfad93-f26c-4d93-8bfc-651e550aef14 of volume 7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:50:10 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Volume volume-7f051c26-414b-4a4c-a7db-cb832392f84e (7f051c26-414b-4a4c-a7db-cb832392f84e): created successfully Jul 24 15:50:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a10a33-10d8-4452-9db3-b406c8526d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Flow 'volume_create_manager' (64d0546e-e617-4267-8108-e7dfa651d34b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:10 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c04086c-fe02-43eb-9585-8efded5bb66c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:10 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-af61c6a1-83c2-4bb0-b669-facdcb3131b7 tempest-GroupSnapshotsTest-1707603888 None] Created volume successfully. Jul 24 15:50:10 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 Jul 24 15:50:10 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:11 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" returned: 0 in 0.390s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:11 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 1G Jul 24 15:50:11 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:11 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 1G" returned: 0 in 0.410s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:11 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 Jul 24 15:50:11 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:11 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14" returned: 0 in 0.316s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:11 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 is being set with open permissions: ugo+rw Jul 24 15:50:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:11 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 Jul 24 15:50:11 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Flow 'volume_create_manager' (06e3951e-6d9a-48c5-b656-c728564b86a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d94bbe-eac1-4360-9e43-99a755ad95b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d94bbe-eac1-4360-9e43-99a755ad95b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-53036615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2759e96-6301-498b-b4b0-998b9f9ccc20,host='devstack@QuobyteHD#QuobyteHD',id=1c990813-5c53-47f5-80a2-adf09e3f20cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc2a01e12564792a3ed38ec923b65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:12Z,use_quota=True,user_id='be830decee614d7c86e5477fb5da5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a00448b0-dbc6-46d4-8d99-2b5fca33e362),volume_type_id=a00448b0-dbc6-46d4-8d99-2b5fca33e362)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06e7192-de0a-4f5f-9654-5c41b571e0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06e7192-de0a-4f5f-9654-5c41b571e0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3230932-149f-4b65-966f-b8338e86d8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3230932-149f-4b65-966f-b8338e86d8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c990813-5c53-47f5-80a2-adf09e3f20cc', 'volume_name': 'volume-1c990813-5c53-47f5-80a2-adf09e3f20cc', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e34c33-3afc-423a-95b4-434523df6674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63e34c33-3afc-423a-95b4-434523df6674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074024ee-131b-4e69-af4b-22e1d864d133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:12 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Volume 1c990813-5c53-47f5-80a2-adf09e3f20cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c990813-5c53-47f5-80a2-adf09e3f20cc', 'volume_size': 1} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:12 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14" returned: 0 in 0.281s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:12 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.info Jul 24 15:50:12 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:12 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.info" returned: 0 in 0.239s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:12 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.info is being set with open permissions: ugo+rw Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:12 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.info Jul 24 15:50:12 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:12 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.info" returned: 0 in 0.234s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.580s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1674342880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68147cb2-6222-4ed5-9a07-1cfef2ebc28d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddab9a393987424b8c1de0a88729f93f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:49:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:49:53Z,use_quota=True,user_id='1ee4321cbd394e0089da889ef87f6eeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Creating volume 68147cb2-6222-4ed5-9a07-1cfef2ebc28d {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:12 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:50:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d 2147483648 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:12 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d 2147483648 Jul 24 15:50:12 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:12 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a15c2157-53d7-4957-8896-82006082b1a7 tempest-SnapshotsActionsTest-506912227 None] Create snapshot completed successfully Jul 24 15:50:13 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d 2147483648" returned: 0 in 0.494s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:13 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d Jul 24 15:50:13 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:13 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d" returned: 0 in 0.236s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.468s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf98b2a-918c-4a58-989c-9439784a597c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d', 'volume_size': 2}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15cbd76-08eb-498c-bde3-c295a1825daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:13 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5fdbf6-a61a-4bf4-8ead-4d914bbd6adc]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:13 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Volume volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d (68147cb2-6222-4ed5-9a07-1cfef2ebc28d): created successfully Jul 24 15:50:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15cbd76-08eb-498c-bde3-c295a1825daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Flow 'volume_create_manager' (e74fa985-31b1-4e68-9a62-0415af3fe9bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:13 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-5bf0aa64-6456-4854-932e-ac15fd1bc2a0 tempest-VolumesCloneNegativeTest-1426726824 None] Created volume successfully. Jul 24 15:50:13 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 Jul 24 15:50:13 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:13 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1" returned: 0 in 0.374s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:13 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e4fb7b-fd1e-40bb-ab8a-d4c249fea186]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:14 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 Jul 24 15:50:14 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b4665d9f-f1d2-4463-b780-40b4f8feb2df tempest-SnapshotsActionsTest-506912227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:14 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1" returned: 0 in 0.431s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73qs_4rqdy.img {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:14 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73qs_4rqdy.img Jul 24 15:50:14 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Acquiring lock "cinder-68147cb2-6222-4ed5-9a07-1cfef2ebc28d-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Lock "cinder-68147cb2-6222-4ed5-9a07-1cfef2ebc28d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Acquiring lock "cinder-quobyte-68147cb2-6222-4ed5-9a07-1cfef2ebc28d" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Lock "cinder-quobyte-68147cb2-6222-4ed5-9a07-1cfef2ebc28d" acquired by "delete_volume" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:14 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb171c5-fd7c-4908-9944-0a9f44870a9b]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:14 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d Jul 24 15:50:14 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:15 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d" returned: 0 in 0.914s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:15 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d Jul 24 15:50:15 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:16 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-68147cb2-6222-4ed5-9a07-1cfef2ebc28d" returned: 0 in 0.669s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Lock "cinder-quobyte-68147cb2-6222-4ed5-9a07-1cfef2ebc28d" released by "delete_volume" :: held 1.648s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:16 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Created reservations ['79f15e26-b1cb-43c0-9a64-ad765943b2cd', '87d8df10-a291-4b5c-910d-2931eb2ea1c9', 'd1a8f9a7-457f-4114-9894-711c00671373', 'f80b4dcd-5767-45e9-802b-f90b355a4dba'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:16 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:50:16 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:17 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.624s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:17 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:17 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Deleted volume successfully. Jul 24 15:50:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f587376a-bf90-4ad3-9847-fae552c951e0 tempest-VolumesCloneNegativeTest-1426726824 None] Lock "cinder-68147cb2-6222-4ed5-9a07-1cfef2ebc28d-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:19 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73qs_4rqdy.img" returned: 0 in 5.080s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:19 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[464ee299-d0f6-4f29-b88e-6c4e9bc67e3d]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:19 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 Jul 24 15:50:19 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:19 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1" returned: 0 in 0.564s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:19 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Image conversion details: src /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1, size 1024.00 MB, duration 5.08 sec, destination /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73qs_4rqdy.img {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:50:19 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Converted 1024.00 MB image at 201.52 MB/s Jul 24 15:50:20 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73 was raw, converting to qcow2 {{(pid=88350) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 24 15:50:20 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb744969-0c25-40d9-a77d-03510ae03c3a]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73qs_4rqdy.img {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:20 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73qs_4rqdy.img Jul 24 15:50:20 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:20 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73qs_4rqdy.img" returned: 0 in 0.342s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73qs_4rqdy.img {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:20 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73qs_4rqdy.img Jul 24 15:50:20 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:20 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73qs_4rqdy.img" returned: 1 in 0.336s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73qs_4rqdy.img' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:50:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73qs_4rqdy.img /opt/stack/data/cinder/conversion/vol_upload_n7ebjq5u {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:20 devstack sudo[98441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73qs_4rqdy.img /opt/stack/data/cinder/conversion/vol_upload_n7ebjq5u Jul 24 15:50:20 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:20 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73qs_4rqdy.img /opt/stack/data/cinder/conversion/vol_upload_n7ebjq5u" returned: 0 in 0.263s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:20 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Image conversion details: src /opt/stack/data/cinder/conversion/0662721b-b0ce-486a-b528-08dee966d4e1.temp_image.cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73qs_4rqdy.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_n7ebjq5u {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:50:20 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 24 15:50:20 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ace7e70-d95b-484d-83da-07b1f3e6730a]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_n7ebjq5u {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:21 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_n7ebjq5u Jul 24 15:50:21 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:21 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_n7ebjq5u" returned: 0 in 0.329s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.422s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Uploaded volume to glance image-id: cafd9c68-9e7d-4e53-b0ff-c3ab1cc8ca73. {{(pid=88350) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 24 15:50:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.755s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2759e96-6301-498b-b4b0-998b9f9ccc20,created_at=2026-07-24T13:50:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-53036615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2759e96-6301-498b-b4b0-998b9f9ccc20,host='devstack@QuobyteHD#QuobyteHD',id=1c990813-5c53-47f5-80a2-adf09e3f20cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc2a01e12564792a3ed38ec923b65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:12Z,use_quota=True,user_id='be830decee614d7c86e5477fb5da5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a00448b0-dbc6-46d4-8d99-2b5fca33e362),volume_type_id=a00448b0-dbc6-46d4-8d99-2b5fca33e362)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Creating volume 1c990813-5c53-47f5-80a2-adf09e3f20cc {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:22 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:50:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:22 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc 1073741824 Jul 24 15:50:22 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:22 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-987117d0-3706-4df5-8824-de2a064471c6 tempest-VolumesActionsTest-2084579446 None] Copy volume to image completed successfully. Jul 24 15:50:23 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc 1073741824" returned: 0 in 0.463s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:23 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc Jul 24 15:50:23 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:23 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc" returned: 0 in 0.312s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b4665d9f-f1d2-4463-b780-40b4f8feb2df tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.562s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074024ee-131b-4e69-af4b-22e1d864d133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c990813-5c53-47f5-80a2-adf09e3f20cc', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf50b9a4-16db-43cd-97c7-ffa88032b325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b4665d9f-f1d2-4463-b780-40b4f8feb2df tempest-SnapshotsActionsTest-506912227 None] Creating offline snapshot b25c307f-0ed5-4bd2-979d-35c54e752053 of volume 7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:50:23 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Volume volume-1c990813-5c53-47f5-80a2-adf09e3f20cc (1c990813-5c53-47f5-80a2-adf09e3f20cc): created successfully Jul 24 15:50:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf50b9a4-16db-43cd-97c7-ffa88032b325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Flow 'volume_create_manager' (06e3951e-6d9a-48c5-b656-c728564b86a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:23 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c1fefe-64be-406c-9802-def5e0382e35]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b4665d9f-f1d2-4463-b780-40b4f8feb2df tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:23 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-90b11298-d4aa-4ad6-aec4-1eff688eba25 tempest-GroupSnapshotsTest-1707603888 None] Created volume successfully. Jul 24 15:50:23 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 Jul 24 15:50:23 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:24 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b4665d9f-f1d2-4463-b780-40b4f8feb2df tempest-SnapshotsActionsTest-506912227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14" returned: 0 in 0.447s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b4665d9f-f1d2-4463-b780-40b4f8feb2df tempest-SnapshotsActionsTest-506912227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b4665d9f-f1d2-4463-b780-40b4f8feb2df tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:24 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053 1G Jul 24 15:50:24 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Acquiring lock "cinder-0662721b-b0ce-486a-b528-08dee966d4e1-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Lock "cinder-0662721b-b0ce-486a-b528-08dee966d4e1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:24 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b4665d9f-f1d2-4463-b780-40b4f8feb2df tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053 1G" returned: 0 in 0.615s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b4665d9f-f1d2-4463-b780-40b4f8feb2df tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:24 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053 Jul 24 15:50:24 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Acquiring lock "cinder-quobyte-0662721b-b0ce-486a-b528-08dee966d4e1" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:25 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Lock "cinder-quobyte-0662721b-b0ce-486a-b528-08dee966d4e1" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:25 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[658cc96a-1d10-419d-a54b-d5e490a54cc3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:25 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e5a362cc-ba8b-475e-b400-f88f09eb8afa tempest-GroupSnapshotsTest-1707603888 None] Update group completed successfully. Jul 24 15:50:25 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 Jul 24 15:50:25 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:25 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b4665d9f-f1d2-4463-b780-40b4f8feb2df tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053" returned: 0 in 0.459s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:25 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-b4665d9f-f1d2-4463-b780-40b4f8feb2df tempest-SnapshotsActionsTest-506912227 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053 is being set with open permissions: ugo+rw Jul 24 15:50:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b4665d9f-f1d2-4463-b780-40b4f8feb2df tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:25 devstack sudo[98479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053 Jul 24 15:50:25 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:25 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1" returned: 0 in 0.484s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:25 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1 Jul 24 15:50:25 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:25 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b4665d9f-f1d2-4463-b780-40b4f8feb2df tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053" returned: 0 in 0.298s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b4665d9f-f1d2-4463-b780-40b4f8feb2df tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:25 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b4665d9f-f1d2-4463-b780-40b4f8feb2df tempest-SnapshotsActionsTest-506912227 None] Create snapshot completed successfully Jul 24 15:50:25 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-0662721b-b0ce-486a-b528-08dee966d4e1" returned: 0 in 0.292s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:25 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Lock "cinder-quobyte-0662721b-b0ce-486a-b528-08dee966d4e1" released by "delete_volume" :: held 0.834s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:25 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Created reservations ['ec4bf8c8-55d6-4185-b960-c331de47e4fe', 'eae35290-5082-4afe-8dd6-622b587dfb03', '823d541c-cda4-4475-b474-be1b2a9a53b4', 'a9744432-8e84-4936-9486-4716fa8950ce'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:26 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:50:26 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Acquiring lock "cinder-b25c307f-0ed5-4bd2-979d-35c54e752053-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-b25c307f-0ed5-4bd2-979d-35c54e752053-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Acquiring lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Acquiring lock "cinder-quobyte-b25c307f-0ed5-4bd2-979d-35c54e752053" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-b25c307f-0ed5-4bd2-979d-35c54e752053" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Deleting offline snapshot b25c307f-0ed5-4bd2-979d-35c54e752053 of volume 7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] snapshot_file for this snap is: volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6782d0e5-b2e9-4462-a59f-41f1c3856d6c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:26 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053 Jul 24 15:50:26 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:26 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.445s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:26 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Deleted volume successfully. Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62b47de1-e264-4af9-b459-283339c83d99 tempest-VolumesActionsTest-2084579446 None] Lock "cinder-0662721b-b0ce-486a-b528-08dee966d4e1-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:26 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a705c4c2-4644-4c69-b6ae-982e3341733d tempest-GroupSnapshotsTest-1707603888 None] Update group completed successfully. Jul 24 15:50:26 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053" returned: 0 in 0.549s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa1971d-df32-49b2-b536-d1771feca55e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:26 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 Jul 24 15:50:26 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:27 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14" returned: 0 in 0.454s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:27 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053 Jul 24 15:50:27 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:27 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-08f76f3a-bd40-437e-9544-7c7c2c62dd60 tempest-GroupSnapshotsTest-1707603888 None] Update group completed successfully. Jul 24 15:50:27 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053" returned: 0 in 0.494s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:27 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053 Jul 24 15:50:27 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:28 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.b25c307f-0ed5-4bd2-979d-35c54e752053" returned: 0 in 0.269s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-b25c307f-0ed5-4bd2-979d-35c54e752053" released by "_delete_snapshot" :: held 1.942s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" released by "delete_snapshot" :: held 1.996s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:28 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Created reservations ['38dc8d71-7715-4f27-9427-eccb5d0ccfb5', 'd53415a5-faa8-4831-a068-7046480b7e73', '07613464-107e-4c0e-86f6-038117a4f7b0', '793ca2f9-8b6c-4913-b07e-c21c71dbfb98'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:28 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Delete snapshot completed successfully. Jul 24 15:50:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e52dac5e-b49b-44e7-afc9-d9706f2d4b36 tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-b25c307f-0ed5-4bd2-979d-35c54e752053-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:28 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-5ec7bdb2-1f5d-4e96-9721-1335018e664e tempest-GroupSnapshotsTest-1707603888 None] Update group completed successfully. Jul 24 15:50:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-33368f11-d4b9-4bf3-a265-afb763300b5a tempest-SnapshotsActionsTest-506912227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-33368f11-d4b9-4bf3-a265-afb763300b5a tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-33368f11-d4b9-4bf3-a265-afb763300b5a tempest-SnapshotsActionsTest-506912227 None] Creating offline snapshot 6d0669d2-848d-4657-9a50-45f04e0de2e2 of volume 7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:50:29 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fec5fa-4d09-4d60-924c-c12a3206a8d1]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-33368f11-d4b9-4bf3-a265-afb763300b5a tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:29 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 Jul 24 15:50:29 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:30 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-33368f11-d4b9-4bf3-a265-afb763300b5a tempest-SnapshotsActionsTest-506912227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14" returned: 0 in 0.612s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-33368f11-d4b9-4bf3-a265-afb763300b5a tempest-SnapshotsActionsTest-506912227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-33368f11-d4b9-4bf3-a265-afb763300b5a tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:30 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2 1G Jul 24 15:50:30 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:30 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] GroupSnapshot 91134ecd-3e0e-4f11-9a7b-bd31e218f9db: creating. Jul 24 15:50:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Group snapshot 91134ecd-3e0e-4f11-9a7b-bd31e218f9db: creating. {{(pid=88350) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 15:50:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:31 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-33368f11-d4b9-4bf3-a265-afb763300b5a tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2 1G" returned: 0 in 0.612s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-33368f11-d4b9-4bf3-a265-afb763300b5a tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:31 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2 Jul 24 15:50:31 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:31 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-33368f11-d4b9-4bf3-a265-afb763300b5a tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2" returned: 0 in 0.398s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:31 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-33368f11-d4b9-4bf3-a265-afb763300b5a tempest-SnapshotsActionsTest-506912227 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2 is being set with open permissions: ugo+rw Jul 24 15:50:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-33368f11-d4b9-4bf3-a265-afb763300b5a tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:31 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2 Jul 24 15:50:31 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:31 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-33368f11-d4b9-4bf3-a265-afb763300b5a tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2" returned: 0 in 0.305s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-33368f11-d4b9-4bf3-a265-afb763300b5a tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.058s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.109s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Creating offline snapshot 58b83450-1b08-4bdc-920f-fe3f6d4bec3d of volume 1c990813-5c53-47f5-80a2-adf09e3f20cc {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:50:31 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-33368f11-d4b9-4bf3-a265-afb763300b5a tempest-SnapshotsActionsTest-506912227 None] Create snapshot completed successfully Jul 24 15:50:31 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7748894-d277-4725-a9c4-2521a4c23214]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:32 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc Jul 24 15:50:32 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:32 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc" returned: 0 in 0.505s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:32 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d 1G Jul 24 15:50:32 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:33 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d 1G" returned: 0 in 0.797s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c990813-5c53-47f5-80a2-adf09e3f20cc -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:33 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c990813-5c53-47f5-80a2-adf09e3f20cc -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d Jul 24 15:50:33 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Acquiring lock "cinder-6d0669d2-848d-4657-9a50-45f04e0de2e2-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-6d0669d2-848d-4657-9a50-45f04e0de2e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Acquiring lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Acquiring lock "cinder-quobyte-6d0669d2-848d-4657-9a50-45f04e0de2e2" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-6d0669d2-848d-4657-9a50-45f04e0de2e2" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Deleting offline snapshot 6d0669d2-848d-4657-9a50-45f04e0de2e2 of volume 7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] snapshot_file for this snap is: volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8824ab4d-4d2c-4c94-9e64-19caaf2f3974]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:33 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2 Jul 24 15:50:33 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:33 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c990813-5c53-47f5-80a2-adf09e3f20cc -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d" returned: 0 in 0.474s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:33 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:33 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d Jul 24 15:50:33 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:33 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2" returned: 0 in 0.560s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f908a58-56bb-4e1b-9826-39cd1e362379]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:34 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d" returned: 0 in 0.415s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:34 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.info Jul 24 15:50:34 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:34 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 Jul 24 15:50:34 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:34 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.info" returned: 0 in 0.311s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:34 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:34 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.info Jul 24 15:50:34 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:34 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14" returned: 0 in 0.613s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:34 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2 Jul 24 15:50:34 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:34 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.info" returned: 0 in 0.467s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.104s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Creating offline snapshot af7c2c75-7b00-4fae-bc8a-af10a2555a64 of volume 7f051c26-414b-4a4c-a7db-cb832392f84e {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[33efe087-03a9-4231-84d4-84e05b0efded]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:35 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e Jul 24 15:50:35 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:35 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2" returned: 0 in 0.644s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:35 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2 Jul 24 15:50:35 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:35 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e" returned: 0 in 0.528s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:35 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64 1G Jul 24 15:50:35 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:35 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.6d0669d2-848d-4657-9a50-45f04e0de2e2" returned: 0 in 0.366s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-6d0669d2-848d-4657-9a50-45f04e0de2e2" released by "_delete_snapshot" :: held 2.362s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" released by "delete_snapshot" :: held 2.401s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:35 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Created reservations ['c8fd69e3-272d-4bb3-b73e-4bba653daa8e', 'fef01a98-3cd0-4539-8e45-cb51fd62a0d3', 'd0c2dc5d-9c0f-474a-a4fe-72018a55cfb1', '6b9830a0-5a76-4072-a1c8-07bbf89c2614'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:35 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Delete snapshot completed successfully. Jul 24 15:50:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8f2345c3-029a-406d-a48f-98baa850f133 tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-6d0669d2-848d-4657-9a50-45f04e0de2e2-delete_snapshot" released by "delete_snapshot" :: held 2.595s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:36 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64 1G" returned: 0 in 0.577s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f051c26-414b-4a4c-a7db-cb832392f84e -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:36 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f051c26-414b-4a4c-a7db-cb832392f84e -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64 Jul 24 15:50:36 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:36 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f051c26-414b-4a4c-a7db-cb832392f84e -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64" returned: 0 in 0.445s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:36 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:36 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64 Jul 24 15:50:36 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Flow 'volume_create_manager' (eeee9e0a-65ed-48b1-a206-4acdd313cf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3c1b69-bfb4-4780-bad9-181e426b1748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c3c1b69-bfb4-4780-bad9-181e426b1748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1833703882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac97ad31-1bef-4756-81fa-3f756f370dd4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a300571d7b1c477dbfba0e327e5590f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:37Z,use_quota=True,user_id='e189f4de2c924c8289422fc01d64fb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99eb9efa-727c-461e-b45d-9842f21b20ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99eb9efa-727c-461e-b45d-9842f21b20ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81fd78ff-e05d-42fa-8ea6-fccea9865d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81fd78ff-e05d-42fa-8ea6-fccea9865d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac97ad31-1bef-4756-81fa-3f756f370dd4', 'volume_name': 'volume-ac97ad31-1bef-4756-81fa-3f756f370dd4', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8036b034-e4cd-43e1-8873-4c0b12fb8ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8036b034-e4cd-43e1-8873-4c0b12fb8ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9dc85bd-7005-4f3f-a645-7ec0c39dc453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:36 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Volume ac97ad31-1bef-4756-81fa-3f756f370dd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac97ad31-1bef-4756-81fa-3f756f370dd4', 'volume_size': 1} Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:36 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64" returned: 0 in 0.304s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:36 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.info Jul 24 15:50:36 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d1f684cd-5eb0-46aa-816f-d219d41b7450 tempest-SnapshotsActionsTest-506912227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:37 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.info" returned: 0 in 0.307s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:37 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:37 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.info Jul 24 15:50:37 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:37 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.info" returned: 0 in 0.246s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.520s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.649s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1833703882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac97ad31-1bef-4756-81fa-3f756f370dd4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a300571d7b1c477dbfba0e327e5590f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:37Z,use_quota=True,user_id='e189f4de2c924c8289422fc01d64fb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Creating volume ac97ad31-1bef-4756-81fa-3f756f370dd4 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:37 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ac97ad31-1bef-4756-81fa-3f756f370dd4 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:37 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ac97ad31-1bef-4756-81fa-3f756f370dd4 1073741824 Jul 24 15:50:37 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:37 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-41089f18-ea6b-413b-af76-fa3915ebea7e tempest-GroupSnapshotsTest-1707603888 None] group_snapshot 91134ecd-3e0e-4f11-9a7b-bd31e218f9db: created successfully Jul 24 15:50:37 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ac97ad31-1bef-4756-81fa-3f756f370dd4 1073741824" returned: 0 in 0.521s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ac97ad31-1bef-4756-81fa-3f756f370dd4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:38 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ac97ad31-1bef-4756-81fa-3f756f370dd4 Jul 24 15:50:38 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:38 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] group_snapshot 91134ecd-3e0e-4f11-9a7b-bd31e218f9db: deleting Jul 24 15:50:38 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ac97ad31-1bef-4756-81fa-3f756f370dd4" returned: 0 in 0.280s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] group_snapshot 91134ecd-3e0e-4f11-9a7b-bd31e218f9db: deleting {{(pid=88350) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d1f684cd-5eb0-46aa-816f-d219d41b7450 tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.249s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9dc85bd-7005-4f3f-a645-7ec0c39dc453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac97ad31-1bef-4756-81fa-3f756f370dd4', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c430220-ac81-4a7a-9b9b-5297e65b391d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d1f684cd-5eb0-46aa-816f-d219d41b7450 tempest-SnapshotsActionsTest-506912227 None] Creating offline snapshot db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 of volume 7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:50:38 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Volume volume-ac97ad31-1bef-4756-81fa-3f756f370dd4 (ac97ad31-1bef-4756-81fa-3f756f370dd4): created successfully Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c430220-ac81-4a7a-9b9b-5297e65b391d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Flow 'volume_create_manager' (eeee9e0a-65ed-48b1-a206-4acdd313cf91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[742b2588-1cc8-42d3-8510-3e3f89b05041]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d1f684cd-5eb0-46aa-816f-d219d41b7450 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "cinder-quobyte-1c990813-5c53-47f5-80a2-adf09e3f20cc" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:38 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-18b42024-335f-4117-aeb6-03cbf80afb0f tempest-VolumesGetTest-1514178004 None] Created volume successfully. Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-1c990813-5c53-47f5-80a2-adf09e3f20cc" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "cinder-quobyte-58b83450-1b08-4bdc-920f-fe3f6d4bec3d" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-58b83450-1b08-4bdc-920f-fe3f6d4bec3d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Deleting offline snapshot 58b83450-1b08-4bdc-920f-fe3f6d4bec3d of volume 1c990813-5c53-47f5-80a2-adf09e3f20cc {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] snapshot_file for this snap is: volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[50612a4b-d554-471f-beb5-83f4ab027fe1]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:38 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 Jul 24 15:50:38 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:38 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d Jul 24 15:50:38 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:38 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d1f684cd-5eb0-46aa-816f-d219d41b7450 tempest-SnapshotsActionsTest-506912227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14" returned: 0 in 0.502s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d1f684cd-5eb0-46aa-816f-d219d41b7450 tempest-SnapshotsActionsTest-506912227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d1f684cd-5eb0-46aa-816f-d219d41b7450 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:38 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 1G Jul 24 15:50:38 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:39 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d" returned: 0 in 0.483s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c990813-5c53-47f5-80a2-adf09e3f20cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8b359a-e906-4404-bfff-7c58c5c56024]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:39 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc Jul 24 15:50:39 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:39 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d1f684cd-5eb0-46aa-816f-d219d41b7450 tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 1G" returned: 0 in 0.616s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d1f684cd-5eb0-46aa-816f-d219d41b7450 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:39 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 Jul 24 15:50:39 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Flow 'volume_create_manager' (157bcea6-24a1-49a4-a042-43ed2bb6c08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:39 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae2c7b2-a204-4e9c-bd5d-224132ad214c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc" returned: 0 in 0.603s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae2c7b2-a204-4e9c-bd5d-224132ad214c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-890130336',display_name='tempest-VolumesGetTest-Volume-1734566603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49d1bfb-47a5-48a7-8005-43de6568a226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a300571d7b1c477dbfba0e327e5590f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:40Z,use_quota=True,user_id='e189f4de2c924c8289422fc01d64fb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32dea974-fd9d-499a-bb18-9ddf6259f2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:39 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d Jul 24 15:50:39 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32dea974-fd9d-499a-bb18-9ddf6259f2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe831ab-76e8-4fb3-8656-8e2766a900fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe831ab-76e8-4fb3-8656-8e2766a900fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c49d1bfb-47a5-48a7-8005-43de6568a226', 'volume_name': 'volume-c49d1bfb-47a5-48a7-8005-43de6568a226', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7e2e86-d67c-469f-a2ab-d683adaf12e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7e2e86-d67c-469f-a2ab-d683adaf12e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d2791f-aeee-453b-ae8f-dc5b6b2a6c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:39 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Volume c49d1bfb-47a5-48a7-8005-43de6568a226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c49d1bfb-47a5-48a7-8005-43de6568a226', 'volume_size': 1} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:39 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d1f684cd-5eb0-46aa-816f-d219d41b7450 tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0" returned: 0 in 0.344s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:39 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-d1f684cd-5eb0-46aa-816f-d219d41b7450 tempest-SnapshotsActionsTest-506912227 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 is being set with open permissions: ugo+rw Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d1f684cd-5eb0-46aa-816f-d219d41b7450 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:39 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 Jul 24 15:50:39 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:40 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:50:40 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:40 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d" returned: 0 in 0.416s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:40 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d Jul 24 15:50:40 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:40 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d1f684cd-5eb0-46aa-816f-d219d41b7450 tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0" returned: 0 in 0.344s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:40 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d1f684cd-5eb0-46aa-816f-d219d41b7450 tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.538s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-890130336',display_name='tempest-VolumesGetTest-Volume-1734566603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49d1bfb-47a5-48a7-8005-43de6568a226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a300571d7b1c477dbfba0e327e5590f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:40Z,use_quota=True,user_id='e189f4de2c924c8289422fc01d64fb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Creating volume c49d1bfb-47a5-48a7-8005-43de6568a226 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:40 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c49d1bfb-47a5-48a7-8005-43de6568a226 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.389s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:40 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c49d1bfb-47a5-48a7-8005-43de6568a226 1073741824 Jul 24 15:50:40 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:50:40 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d1f684cd-5eb0-46aa-816f-d219d41b7450 tempest-SnapshotsActionsTest-506912227 None] Create snapshot completed successfully Jul 24 15:50:40 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc.58b83450-1b08-4bdc-920f-fe3f6d4bec3d" returned: 0 in 0.369s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-58b83450-1b08-4bdc-920f-fe3f6d4bec3d" released by "_delete_snapshot" :: held 2.043s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-1c990813-5c53-47f5-80a2-adf09e3f20cc" released by "delete_snapshot" :: held 2.074s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "cinder-quobyte-7f051c26-414b-4a4c-a7db-cb832392f84e" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-7f051c26-414b-4a4c-a7db-cb832392f84e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "cinder-quobyte-af7c2c75-7b00-4fae-bc8a-af10a2555a64" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-af7c2c75-7b00-4fae-bc8a-af10a2555a64" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Deleting offline snapshot af7c2c75-7b00-4fae-bc8a-af10a2555a64 of volume 7f051c26-414b-4a4c-a7db-cb832392f84e {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] snapshot_file for this snap is: volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a718af55-fb2e-4d49-bdc5-aec42ff01040]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:40 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64 Jul 24 15:50:40 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:40 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c49d1bfb-47a5-48a7-8005-43de6568a226 1073741824" returned: 0 in 0.544s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c49d1bfb-47a5-48a7-8005-43de6568a226 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:40 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c49d1bfb-47a5-48a7-8005-43de6568a226 Jul 24 15:50:40 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:41 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64" returned: 0 in 0.433s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f051c26-414b-4a4c-a7db-cb832392f84e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[177f6684-316b-4dc1-a41f-5196bfdeac83]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:41 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c49d1bfb-47a5-48a7-8005-43de6568a226" returned: 0 in 0.284s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d2791f-aeee-453b-ae8f-dc5b6b2a6c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c49d1bfb-47a5-48a7-8005-43de6568a226', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71b8e0b-2d4b-4295-90fe-f95d042e6485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:41 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Volume volume-c49d1bfb-47a5-48a7-8005-43de6568a226 (c49d1bfb-47a5-48a7-8005-43de6568a226): created successfully Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a71b8e0b-2d4b-4295-90fe-f95d042e6485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Flow 'volume_create_manager' (157bcea6-24a1-49a4-a042-43ed2bb6c08a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:41 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-13d00d46-7a8f-4ae3-babd-92df453a372c tempest-VolumesGetTest-1514178004 None] Created volume successfully. Jul 24 15:50:41 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e Jul 24 15:50:41 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Acquiring lock "cinder-db13a37c-2dbd-46f6-9fe1-19c58d4cdac0-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-db13a37c-2dbd-46f6-9fe1-19c58d4cdac0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Acquiring lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Acquiring lock "cinder-quobyte-db13a37c-2dbd-46f6-9fe1-19c58d4cdac0" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-db13a37c-2dbd-46f6-9fe1-19c58d4cdac0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Deleting offline snapshot db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 of volume 7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] snapshot_file for this snap is: volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e193332b-ab63-4895-8d75-f5211dbdc6a7]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:41 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 Jul 24 15:50:41 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:41 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e" returned: 0 in 0.586s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:41 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64 Jul 24 15:50:41 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-c49d1bfb-47a5-48a7-8005-43de6568a226-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:42 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Lock "cinder-c49d1bfb-47a5-48a7-8005-43de6568a226-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0" returned: 0 in 0.591s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ad0431-eac7-47d5-a1af-f8c5a97baab0]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-quobyte-c49d1bfb-47a5-48a7-8005-43de6568a226" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-c49d1bfb-47a5-48a7-8005-43de6568a226" acquired by "delete_volume" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[513d8fa9-70b2-4cf3-921c-3acc9dd579a4]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c49d1bfb-47a5-48a7-8005-43de6568a226 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:42 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 Jul 24 15:50:42 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:42 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64" returned: 0 in 0.588s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:42 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64 Jul 24 15:50:42 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:42 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c49d1bfb-47a5-48a7-8005-43de6568a226 Jul 24 15:50:42 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:42 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:42 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e.af7c2c75-7b00-4fae-bc8a-af10a2555a64" returned: 0 in 0.344s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14" returned: 0 in 0.545s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:42 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-af7c2c75-7b00-4fae-bc8a-af10a2555a64" released by "_delete_snapshot" :: held 2.077s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c49d1bfb-47a5-48a7-8005-43de6568a226" returned: 0 in 0.488s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c49d1bfb-47a5-48a7-8005-43de6568a226 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:42 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 Jul 24 15:50:42 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-7f051c26-414b-4a4c-a7db-cb832392f84e" released by "delete_snapshot" :: held 2.132s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:42 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c49d1bfb-47a5-48a7-8005-43de6568a226 Jul 24 15:50:42 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:42 devstack cinder-volume[88350]: WARNING cinder.quota [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1965601259 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1965601259, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:50:42 devstack cinder-volume[88350]: WARNING cinder.quota [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1965601259 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1965601259, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:50:42 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Created reservations ['e8f30688-9b9d-4f75-a8c5-ee9234155244', 'e1663ff8-93f9-4393-9d34-d140dfada1d2', '2f8b7656-ee67-4ee5-9a59-b86829e1b88c', '1765f03a-d82c-41e0-85bc-5d742d9e5bf0'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:43 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c49d1bfb-47a5-48a7-8005-43de6568a226" returned: 0 in 0.303s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-c49d1bfb-47a5-48a7-8005-43de6568a226" released by "delete_volume" :: held 0.846s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] Created reservations ['5d52cc7d-3331-4b82-b32e-ed6f1604b384', '4e441980-fb63-48f4-b0d2-a369d35459af', 'c2abb4c3-d18b-43dd-a9d5-8765fc2f0442', 'ea7f8e6a-cf4d-4f35-9a43-9dcc621e3fc1'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Created reservations ['6adf56ab-9d83-488a-9b24-a49f1171200b', '56d37b59-bc47-4e99-8711-a76df0681c2d', '4202f1f4-5a54-4bd0-bd65-aea7b2525d38', 'd0644a79-291c-44d6-a092-5ce0d4121069'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:43 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0" returned: 0 in 0.551s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:43 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-43a5e32f-c7f7-41aa-98aa-1db017dc1c7e tempest-GroupSnapshotsTest-1707603888 None] group_snapshot 91134ecd-3e0e-4f11-9a7b-bd31e218f9db: deleted successfully Jul 24 15:50:43 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0 Jul 24 15:50:43 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:43 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:50:43 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-ac97ad31-1bef-4756-81fa-3f756f370dd4-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Lock "cinder-ac97ad31-1bef-4756-81fa-3f756f370dd4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-quobyte-ac97ad31-1bef-4756-81fa-3f756f370dd4" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-ac97ad31-1bef-4756-81fa-3f756f370dd4" acquired by "delete_volume" :: waited 0.029s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b869a186-f11f-4d50-b5a8-2c0c862e1508]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ac97ad31-1bef-4756-81fa-3f756f370dd4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:43 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.db13a37c-2dbd-46f6-9fe1-19c58d4cdac0" returned: 0 in 0.448s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:43 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.402s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-db13a37c-2dbd-46f6-9fe1-19c58d4cdac0" released by "_delete_snapshot" :: held 2.277s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:43 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Deleted volume successfully. Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" released by "delete_snapshot" :: held 2.313s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7305bff9-c459-496e-acd5-eca588fd7266 tempest-VolumesGetTest-1514178004 None] Lock "cinder-c49d1bfb-47a5-48a7-8005-43de6568a226-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:43 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ac97ad31-1bef-4756-81fa-3f756f370dd4 Jul 24 15:50:43 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Created reservations ['7c38e930-c5ca-4be9-b190-30a0733e0f9e', '512fd334-9a60-4b82-ab0f-5a244aa6a1f9', '8a7fde20-2310-4f15-b096-3ea53c8bdc4f', '390e4454-32bf-49a2-af70-f285460d80ca'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:43 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Delete snapshot completed successfully. Jul 24 15:50:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-eb7af58f-1d2d-47c1-9d77-07de2e5aae6c tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-db13a37c-2dbd-46f6-9fe1-19c58d4cdac0-delete_snapshot" released by "delete_snapshot" :: held 2.508s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:44 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ac97ad31-1bef-4756-81fa-3f756f370dd4" returned: 0 in 0.443s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ac97ad31-1bef-4756-81fa-3f756f370dd4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:44 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ac97ad31-1bef-4756-81fa-3f756f370dd4 Jul 24 15:50:44 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:44 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ac97ad31-1bef-4756-81fa-3f756f370dd4" returned: 0 in 0.273s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-ac97ad31-1bef-4756-81fa-3f756f370dd4" released by "delete_volume" :: held 0.767s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:44 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Created reservations ['7d084911-db63-41af-a026-5720053f192b', '85aee35f-8c06-443d-a797-f27ee424d7a2', '25c3bec9-ad24-466e-b390-a488ed227d09', '86c13731-0a83-4b9c-8f14-abe28a214c52'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "cinder-quobyte-1c990813-5c53-47f5-80a2-adf09e3f20cc" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-1c990813-5c53-47f5-80a2-adf09e3f20cc" acquired by "delete_volume" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:44 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[713c191c-a480-4b44-9566-dcc5e849ee06]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:44 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:50:44 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:44 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc Jul 24 15:50:44 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:45 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.375s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-59e6d369-b564-4014-8c9e-b26dda5d0e55 tempest-SnapshotsActionsTest-506912227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-59e6d369-b564-4014-8c9e-b26dda5d0e55 tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:45 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Deleted volume successfully. Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-59e6d369-b564-4014-8c9e-b26dda5d0e55 tempest-SnapshotsActionsTest-506912227 None] Creating offline snapshot 1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 of volume 7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d573b727-8846-4216-97ca-969796b00949 tempest-VolumesGetTest-1514178004 None] Lock "cinder-ac97ad31-1bef-4756-81fa-3f756f370dd4-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f35fd65-674d-4cd7-a89e-82cdc5a2d158]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59e6d369-b564-4014-8c9e-b26dda5d0e55 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:45 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc" returned: 0 in 0.611s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:45 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc Jul 24 15:50:45 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:45 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 Jul 24 15:50:45 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:45 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1c990813-5c53-47f5-80a2-adf09e3f20cc" returned: 0 in 0.294s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-1c990813-5c53-47f5-80a2-adf09e3f20cc" released by "delete_volume" :: held 0.996s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "cinder-quobyte-7f051c26-414b-4a4c-a7db-cb832392f84e" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-7f051c26-414b-4a4c-a7db-cb832392f84e" acquired by "delete_volume" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:45 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59e6d369-b564-4014-8c9e-b26dda5d0e55 tempest-SnapshotsActionsTest-506912227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14" returned: 0 in 0.445s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-59e6d369-b564-4014-8c9e-b26dda5d0e55 tempest-SnapshotsActionsTest-506912227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59e6d369-b564-4014-8c9e-b26dda5d0e55 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d4b1a6-6ce1-431c-a581-3e0ad7f8e17e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:45 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 1G Jul 24 15:50:45 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:45 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e Jul 24 15:50:45 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:46 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:46 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59e6d369-b564-4014-8c9e-b26dda5d0e55 tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 1G" returned: 0 in 0.575s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59e6d369-b564-4014-8c9e-b26dda5d0e55 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e" returned: 0 in 0.573s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:46 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 Jul 24 15:50:46 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:46 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e Jul 24 15:50:46 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Flow 'volume_create_manager' (39596231-733a-470f-964d-69bee0a022f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2c3af5-1ca2-4b69-815e-a4b1d43e372d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d2c3af5-1ca2-4b69-815e-a4b1d43e372d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-9539464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47a96ac-e093-45c0-aaaa-86da8014ea9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a300571d7b1c477dbfba0e327e5590f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:46Z,use_quota=True,user_id='e189f4de2c924c8289422fc01d64fb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ac1f36-6831-48d8-9261-3547f0e2c88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03ac1f36-6831-48d8-9261-3547f0e2c88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50dc8271-7196-4a45-b824-f8f40ea7442e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50dc8271-7196-4a45-b824-f8f40ea7442e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e47a96ac-e093-45c0-aaaa-86da8014ea9a', 'volume_name': 'volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d4d6a1-a9dd-48a2-8340-cac43908550f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d4d6a1-a9dd-48a2-8340-cac43908550f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab393f5-8b2c-4386-98d2-26ebf809fbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:46 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Volume e47a96ac-e093-45c0-aaaa-86da8014ea9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a', 'volume_size': 1} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:46 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f051c26-414b-4a4c-a7db-cb832392f84e" returned: 0 in 0.335s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:46 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59e6d369-b564-4014-8c9e-b26dda5d0e55 tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151" returned: 0 in 0.378s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:46 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-59e6d369-b564-4014-8c9e-b26dda5d0e55 tempest-SnapshotsActionsTest-506912227 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 is being set with open permissions: ugo+rw Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59e6d369-b564-4014-8c9e-b26dda5d0e55 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-7f051c26-414b-4a4c-a7db-cb832392f84e" released by "delete_volume" :: held 1.012s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:46 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 Jul 24 15:50:46 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Created reservations ['d766419b-0a53-4876-a50e-4b58100b736d'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:46 devstack cinder-volume[88350]: WARNING cinder.quota [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1965601259 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1965601259, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Created reservations ['68c82855-e59c-49b6-b330-152eaa1f3429', '57d88bd1-bfe4-47e1-9ecf-ffee41762d09', '53296398-16c5-4f66-b318-5ece71706beb', 'd5d6bae5-6a00-45c8-943d-79848311a25c'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:46 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Created reservations ['d13c6fa8-b9cb-4055-863a-e7b47f293237', 'c99ccfea-3f5e-4626-a9bc-09887b02e109', 'd1c77cad-bbc6-4ece-b4ab-3a37a1ae75d5', '2e7d1ff5-82ab-4153-af10-90230bbd78ab'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:47 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59e6d369-b564-4014-8c9e-b26dda5d0e55 tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151" returned: 0 in 0.285s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-59e6d369-b564-4014-8c9e-b26dda5d0e55 tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.807s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.541s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-9539464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47a96ac-e093-45c0-aaaa-86da8014ea9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a300571d7b1c477dbfba0e327e5590f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:46Z,use_quota=True,user_id='e189f4de2c924c8289422fc01d64fb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Creating volume e47a96ac-e093-45c0-aaaa-86da8014ea9a {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:47 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:47 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a 1073741824 Jul 24 15:50:47 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:47 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-59e6d369-b564-4014-8c9e-b26dda5d0e55 tempest-SnapshotsActionsTest-506912227 None] Create snapshot completed successfully Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:47 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:50:47 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:47 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.430s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:47 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-cbf92952-f3d8-467e-afbc-b6952092ffcf tempest-GroupSnapshotsTest-1707603888 None] Delete group completed successfully. Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Acquiring lock "cinder-1cbd594d-e5c0-4b14-8d4f-22e3f0b08151-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-1cbd594d-e5c0-4b14-8d4f-22e3f0b08151-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Acquiring lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Acquiring lock "cinder-quobyte-1cbd594d-e5c0-4b14-8d4f-22e3f0b08151" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-1cbd594d-e5c0-4b14-8d4f-22e3f0b08151" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Deleting offline snapshot 1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 of volume 7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] snapshot_file for this snap is: volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39f0cb7-a840-4d11-898f-74b764b5d983]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:47 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a 1073741824" returned: 0 in 0.842s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:48 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a Jul 24 15:50:48 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:48 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 Jul 24 15:50:48 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:48 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b3d10789-b61e-4045-a6a6-54e612e453ad tempest-GroupSnapshotsTest-1707603888 None] Group tempest-GroupSnapshotsTest-Group-655399112: creating Jul 24 15:50:48 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b3d10789-b61e-4045-a6a6-54e612e453ad tempest-GroupSnapshotsTest-1707603888 None] Group tempest-GroupSnapshotsTest-Group-655399112: created successfully Jul 24 15:50:48 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b3d10789-b61e-4045-a6a6-54e612e453ad tempest-GroupSnapshotsTest-1707603888 None] Create group completed successfully. Jul 24 15:50:48 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a" returned: 0 in 0.385s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ab393f5-8b2c-4386-98d2-26ebf809fbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2030a72c-cc6f-4147-886f-8dcaa504e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:48 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Volume volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a (e47a96ac-e093-45c0-aaaa-86da8014ea9a): created successfully Jul 24 15:50:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2030a72c-cc6f-4147-886f-8dcaa504e8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Flow 'volume_create_manager' (39596231-733a-470f-964d-69bee0a022f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:48 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a3e0da6b-3d80-4294-8764-437d8b7f0a6d tempest-VolumesGetTest-1514178004 None] Created volume successfully. Jul 24 15:50:48 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151" returned: 0 in 0.743s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:48 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd98f62-3bf2-4d9d-b3bc-6420dc6eaf82]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:48 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 Jul 24 15:50:48 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:49 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14" returned: 0 in 0.386s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:49 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 Jul 24 15:50:49 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:49 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151" returned: 0 in 0.444s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:49 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151 Jul 24 15:50:49 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:49 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.1cbd594d-e5c0-4b14-8d4f-22e3f0b08151" returned: 0 in 0.376s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-1cbd594d-e5c0-4b14-8d4f-22e3f0b08151" released by "_delete_snapshot" :: held 2.089s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Flow 'volume_create_manager' (7bff4aef-7a3a-43f5-8b8c-bca2222daf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819cb797-7e25-42df-9bde-89edeabf6fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" released by "delete_snapshot" :: held 2.166s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819cb797-7e25-42df-9bde-89edeabf6fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-55684867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=282c992b-fcfb-43d0-9cc4-d42b181b215e,host='devstack@QuobyteHD#QuobyteHD',id=e79ac464-55f2-407f-be0c-afff618b710a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc2a01e12564792a3ed38ec923b65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:50Z,use_quota=True,user_id='be830decee614d7c86e5477fb5da5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef30b481-a2bf-46eb-bdc9-20933ce1d608),volume_type_id=ef30b481-a2bf-46eb-bdc9-20933ce1d608)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2485db9b-a470-4a2f-825c-3ead1a8bb032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2485db9b-a470-4a2f-825c-3ead1a8bb032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d823e79d-cd3f-4aca-88dd-551fd0e10570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d823e79d-cd3f-4aca-88dd-551fd0e10570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e79ac464-55f2-407f-be0c-afff618b710a', 'volume_name': 'volume-e79ac464-55f2-407f-be0c-afff618b710a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4002e6-f47e-4cb9-bf0d-92d9d5886dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c4002e6-f47e-4cb9-bf0d-92d9d5886dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ecac7dd-cbf9-4301-9695-0da449dbab9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:49 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Volume e79ac464-55f2-407f-be0c-afff618b710a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e79ac464-55f2-407f-be0c-afff618b710a', 'volume_size': 1} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=282c992b-fcfb-43d0-9cc4-d42b181b215e,created_at=2026-07-24T13:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-55684867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=282c992b-fcfb-43d0-9cc4-d42b181b215e,host='devstack@QuobyteHD#QuobyteHD',id=e79ac464-55f2-407f-be0c-afff618b710a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdc2a01e12564792a3ed38ec923b65b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:50Z,use_quota=True,user_id='be830decee614d7c86e5477fb5da5e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef30b481-a2bf-46eb-bdc9-20933ce1d608),volume_type_id=ef30b481-a2bf-46eb-bdc9-20933ce1d608)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Creating volume e79ac464-55f2-407f-be0c-afff618b710a {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:50:49 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:50 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a 1073741824 Jul 24 15:50:50 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Created reservations ['73a2877e-435f-4e67-b684-bbd900465ece', '5cff5ed0-9364-4944-b31d-b3386ad69740', '18d754c1-b4e5-433f-a847-ea4f06bde7b5', '53548266-7cdb-4509-8786-4d1bc20a27c1'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:50 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Delete snapshot completed successfully. Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0d3b65c8-b29c-4eb6-b033-a13990be4f5d tempest-SnapshotsActionsTest-2072741071 None] Lock "cinder-1cbd594d-e5c0-4b14-8d4f-22e3f0b08151-delete_snapshot" released by "delete_snapshot" :: held 2.574s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Flow 'volume_create_manager' (d5d7f0d8-192b-42c2-aeae-fbdc9fbaf75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfa3692-ba7d-4ddf-a71f-89595c1efd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccfa3692-ba7d-4ddf-a71f-89595c1efd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1607649330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fa5633-21d0-4672-86d9-17aa0ac1c9d2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a300571d7b1c477dbfba0e327e5590f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e47a96ac-e093-45c0-aaaa-86da8014ea9a,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:50Z,use_quota=True,user_id='e189f4de2c924c8289422fc01d64fb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d363c8b3-a21f-4379-8817-6a35a6032045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:50 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d363c8b3-a21f-4379-8817-6a35a6032045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdff8d12-5f15-4e35-a9b2-ad262166496a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a 1073741824" returned: 0 in 0.528s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdff8d12-5f15-4e35-a9b2-ad262166496a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f9fa5633-21d0-4672-86d9-17aa0ac1c9d2', 'volume_name': 'volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2', 'volume_size': 1, 'source_volid': 'e47a96ac-e093-45c0-aaaa-86da8014ea9a', 'source_volstatus': 'available'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326b0d5d-2e1d-4be3-8275-d92080ffcb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326b0d5d-2e1d-4be3-8275-d92080ffcb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584276ad-4898-4e90-82f3-c090896051e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:50 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Volume f9fa5633-21d0-4672-86d9-17aa0ac1c9d2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2', 'volume_size': 1, 'source_volid': 'e47a96ac-e093-45c0-aaaa-86da8014ea9a', 'source_volstatus': 'available'} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:50 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a Jul 24 15:50:50 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:50 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a" returned: 0 in 0.241s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.263s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:50 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Cloning volume e47a96ac-e093-45c0-aaaa-86da8014ea9a to volume f9fa5633-21d0-4672-86d9-17aa0ac1c9d2 Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ecac7dd-cbf9-4301-9695-0da449dbab9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e79ac464-55f2-407f-be0c-afff618b710a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e69b45e-9fa6-43b4-bec6-15630594b309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:50 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Volume volume-e79ac464-55f2-407f-be0c-afff618b710a (e79ac464-55f2-407f-be0c-afff618b710a): created successfully Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e69b45e-9fa6-43b4-bec6-15630594b309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Flow 'volume_create_manager' (7bff4aef-7a3a-43f5-8b8c-bca2222daf35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Creating offline snapshot 37f2f6e4-6a65-453e-862c-a1da01e04a38 of volume e47a96ac-e093-45c0-aaaa-86da8014ea9a {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:50:50 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-16abf5f4-b3b4-4c93-93c8-609ad6175a52 tempest-GroupSnapshotsTest-1707603888 None] Created volume successfully. Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbf9b8a-3a57-4fba-85ed-9e4163756f66]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:51 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a Jul 24 15:50:51 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:51 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a" returned: 0 in 0.465s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:51 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 1G Jul 24 15:50:51 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:51 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] GroupSnapshot 2854930d-c516-4bc8-bec6-9531f206186a: creating. Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] Group snapshot 2854930d-c516-4bc8-bec6-9531f206186a: creating. {{(pid=88350) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Acquiring lock "cinder-59cfad93-f26c-4d93-8bfc-651e550aef14-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Lock "cinder-59cfad93-f26c-4d93-8bfc-651e550aef14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Acquiring lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Acquiring lock "cinder-quobyte-59cfad93-f26c-4d93-8bfc-651e550aef14" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Lock "cinder-quobyte-59cfad93-f26c-4d93-8bfc-651e550aef14" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Deleting offline snapshot 59cfad93-f26c-4d93-8bfc-651e550aef14 of volume 7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] snapshot_file for this snap is: volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d098e01-2c65-4047-adb4-19eda73d14fb]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:51 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 Jul 24 15:50:51 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:51 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 1G" returned: 0 in 0.558s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:51 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 Jul 24 15:50:51 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:52 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14" returned: 0 in 0.403s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:52 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[575dd67d-d6aa-4065-9498-8606bab71318]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:52 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 Jul 24 15:50:52 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:52 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38" returned: 0 in 0.336s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:52 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 is being set with open permissions: ugo+rw Jul 24 15:50:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:52 devstack sudo[98828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 Jul 24 15:50:52 devstack sudo[98828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:52 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" returned: 0 in 0.393s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:52 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 Jul 24 15:50:52 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:52 devstack sudo[98828]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38" returned: 0 in 0.299s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:52 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.info Jul 24 15:50:52 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:52 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.info" returned: 0 in 0.287s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:52 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.info is being set with open permissions: ugo+rw Jul 24 15:50:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:52 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14" returned: 0 in 0.399s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:52 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.info Jul 24 15:50:52 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:52 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14 Jul 24 15:50:52 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Flow 'volume_create_manager' (4260bd99-14c3-4ee2-a6f7-77e6e881b997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed39a2e-76f1-416d-9fcb-14ad15d23310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:53 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.info" returned: 0 in 0.297s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:53 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-quobyte-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2" by "_copy_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1.59cfad93-f26c-4d93-8bfc-651e550aef14" returned: 0 in 0.301s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed39a2e-76f1-416d-9fcb-14ad15d23310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1546777924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34edef0e-f882-4dcc-8dcc-88de11bedcf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b498ab30c3c34ec686f3f71ef2083acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:53Z,use_quota=True,user_id='d1ec4c4c1eac4e5fada27303dbd071ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08601bf3-6be5-40c3-b836-3fcaf401b6ef),volume_type_id=08601bf3-6be5-40c3-b836-3fcaf401b6ef)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fe9923-66f8-4c1e-bf40-e6f50680034f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48fe9923-66f8-4c1e-bf40-e6f50680034f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97390c2-a00c-448f-a726-150bc6b634dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97390c2-a00c-448f-a726-150bc6b634dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34edef0e-f882-4dcc-8dcc-88de11bedcf3', 'volume_name': 'volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a08b3c0-5a47-4b97-8ed6-8dc70241a02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a08b3c0-5a47-4b97-8ed6-8dc70241a02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457c5966-2aba-4eb9-8e82-8d4b8149dc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:53 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Volume 34edef0e-f882-4dcc-8dcc-88de11bedcf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3', 'volume_size': 1} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2" acquired by "_copy_volume_from_snapshot" :: waited 0.077s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] snapshot: 37f2f6e4-6a65-453e-862c-a1da01e04a38, volume: f9fa5633-21d0-4672-86d9-17aa0ac1c9d2, {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c314eeb-6dc4-41a4-b5a9-2fd81f4d80e0]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Lock "cinder-quobyte-59cfad93-f26c-4d93-8bfc-651e550aef14" released by "_delete_snapshot" :: held 1.713s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" released by "delete_snapshot" :: held 1.749s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Created reservations ['e9a9765c-ad99-4735-863d-d6a18c6eceb7', 'c0af5acf-d156-4e77-a44e-af0eb15d4129', '98f0fe5c-ea79-45e9-96ca-aca29c7321fa', 'f0f8766a-0735-4e9c-b288-a6c4774af38f'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:53 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 Jul 24 15:50:53 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:53 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Delete snapshot completed successfully. Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d8dbfd0b-4252-4f4e-b5bb-e7439f717757 tempest-SnapshotsActionsTest-506912227 None] Lock "cinder-59cfad93-f26c-4d93-8bfc-651e550aef14-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Flow 'volume_create_manager' (acacbfea-402b-4509-af04-6b28e969dc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5e57a6-bebe-4ba1-941c-f8f77d5dae43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5e57a6-bebe-4ba1-941c-f8f77d5dae43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1154211992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efce9afd-75dd-468b-b86d-5c700ea05f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b498ab30c3c34ec686f3f71ef2083acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:54Z,use_quota=True,user_id='d1ec4c4c1eac4e5fada27303dbd071ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f3632a3-5094-4a9c-a20d-ec66aa295a5f),volume_type_id=3f3632a3-5094-4a9c-a20d-ec66aa295a5f)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a28c711-5f02-46d8-8dc0-023f134b01e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a28c711-5f02-46d8-8dc0-023f134b01e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8d27ae-7412-4e6a-93e4-be063c8a15f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8d27ae-7412-4e6a-93e4-be063c8a15f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efce9afd-75dd-468b-b86d-5c700ea05f36', 'volume_name': 'volume-efce9afd-75dd-468b-b86d-5c700ea05f36', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001f80a2-17c1-43da-83f3-fd960abff44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (001f80a2-17c1-43da-83f3-fd960abff44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74eb46d-bd80-4d00-87d1-a4b6f3d12821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:53 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Volume efce9afd-75dd-468b-b86d-5c700ea05f36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efce9afd-75dd-468b-b86d-5c700ea05f36', 'volume_size': 1} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:53 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38" returned: 0 in 0.471s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Creating direct copy from snapshot {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a399622-e3c7-4974-af1c-31c44a6e1a9e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Acquiring lock "cinder-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:53 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a Jul 24 15:50:53 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Lock "cinder-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Acquiring lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd285999-ac19-4398-9613-0bb08c69da9d]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:54 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a" returned: 0 in 0.432s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.utils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Path /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2 not found in is_blk_device check {{(pid=88350) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:54 devstack sudo[98858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 Jul 24 15:50:54 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:54 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2 Jul 24 15:50:54 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Flow 'volume_create_manager' (f2050335-a784-471e-b447-d2615acb3635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bac4112-b183-4285-9f8e-35c9501207c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bac4112-b183-4285-9f8e-35c9501207c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1120057268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e651c6-a7e2-438e-8c75-ed9cd7203c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b498ab30c3c34ec686f3f71ef2083acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:54Z,use_quota=True,user_id='d1ec4c4c1eac4e5fada27303dbd071ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5525b4-afc2-481f-b41c-6dd6be9593b6),volume_type_id=bb5525b4-afc2-481f-b41c-6dd6be9593b6)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743c4d91-fc06-4d27-b4e9-819b0afabf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (743c4d91-fc06-4d27-b4e9-819b0afabf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8bbd2cf-74da-49a0-8aea-85da17502754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.image.glance [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Creating Keystone auth plugin from conf {{(pid=88350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:50:54 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" returned: 0 in 0.425s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:54 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1 Jul 24 15:50:54 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8bbd2cf-74da-49a0-8aea-85da17502754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '94e651c6-a7e2-438e-8c75-ed9cd7203c74', 'volume_name': 'volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74', 'volume_size': 1, 'image_id': 'ba348b23-d620-437f-a1e6-42324878b776', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba348b23-d620-437f-a1e6-42324878b776', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--770637047', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b498ab30c3c34ec686f3f71ef2083acd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ba348b23-d620-437f-a1e6-42324878b776', 'created_at': datetime.datetime(2026, 7, 24, 13, 50, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 50, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba348b23-d620-437f-a1e6-42324878b776/file', 'properties': {}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6293ce4f-5776-4f88-90d9-6834ff4fba33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6293ce4f-5776-4f88-90d9-6834ff4fba33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b23ddc6-2fa0-4b49-b388-12d068c76b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:50:54 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Volume 94e651c6-a7e2-438e-8c75-ed9cd7203c74: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74', 'volume_size': 1, 'image_id': 'ba348b23-d620-437f-a1e6-42324878b776', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba348b23-d620-437f-a1e6-42324878b776', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--770637047', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b498ab30c3c34ec686f3f71ef2083acd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ba348b23-d620-437f-a1e6-42324878b776', 'created_at': datetime.datetime(2026, 7, 24, 13, 50, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 50, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba348b23-d620-437f-a1e6-42324878b776/file', 'properties': {}}, 'image_service': } Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Trying to clone 94e651c6-a7e2-438e-8c75-ed9cd7203c74 from image ba348b23-d620-437f-a1e6-42324878b776 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ba348b23-d620-437f-a1e6-42324878b776', 'metadata': {}}]). {{(pid=88350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:50:54 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" returned: 0 in 0.341s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Lock "cinder-quobyte-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1" released by "delete_volume" :: held 0.853s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:55 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Created reservations ['03615ebf-f8fd-40ca-a99c-672659c0e273', '7afe87a2-1947-4ae5-998e-83520863cae1', '82b20ec8-9491-4e6e-9e98-4b64388a22d5', '8a80358c-608d-4a5e-912d-2b6638cff72d'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:50:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:50:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:50:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:50:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:50:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:50:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:50:55 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:50:55 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:50:56 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.905s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:56 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:50:56 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Deleted volume successfully. Jul 24 15:50:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1d16e3f3-9280-4c14-b9f6-9e4b206ade91 tempest-SnapshotsActionsTest-506912227 None] Lock "cinder-7cbaf7e3-15c2-4bb6-a8c5-3738ed2b5ac1-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:50:59 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Jul 24 15:50:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2" returned: 0 in 5.657s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:50:59 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f39a828-7df6-4b0a-b582-f6d39282a6a3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:50:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:00 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a Jul 24 15:51:00 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:00 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a" returned: 0 in 0.635s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:00 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Image conversion details: src /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2 {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:51:00 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Converted 1024.00 MB image at 180.97 MB/s Jul 24 15:51:00 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2 is being set with open permissions: ugo+rw Jul 24 15:51:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:00 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2 Jul 24 15:51:00 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:00 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2" returned: 0 in 0.265s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2" released by "_copy_volume_from_snapshot" :: held 7.569s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-quobyte-37f2f6e4-6a65-453e-862c-a1da01e04a38" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-37f2f6e4-6a65-453e-862c-a1da01e04a38" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Deleting offline snapshot 37f2f6e4-6a65-453e-862c-a1da01e04a38 of volume e47a96ac-e093-45c0-aaaa-86da8014ea9a {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:51:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] snapshot_file for this snap is: volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:51:00 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6c8fb4-2144-445e-b27a-e8aef8437711]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:01 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 Jul 24 15:51:01 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:01 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ba348b23-d620-437f-a1e6-42324878b776_r4bl72godevstack@QuobyteHD, size 20.69 MB, duration 6.64 sec {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:51:01 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Image download 20.69 MB at 3.11 MB/s Jul 24 15:51:01 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38" returned: 0 in 0.435s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:51:01 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[be82ad07-6b06-4651-8324-82956710a987]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:01 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e1dc66-59e0-4e48-b1d6-bed0b20d699e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba348b23-d620-437f-a1e6-42324878b776_r4bl72godevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:01 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba348b23-d620-437f-a1e6-42324878b776_r4bl72godevstack@QuobyteHD Jul 24 15:51:01 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:01 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a Jul 24 15:51:01 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:01 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba348b23-d620-437f-a1e6-42324878b776_r4bl72godevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:01 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Temporary image ba348b23-d620-437f-a1e6-42324878b776 is fetched for user d1ec4c4c1eac4e5fada27303dbd071ea. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:51:01 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a" returned: 0 in 0.431s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:01 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 Jul 24 15:51:01 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:01 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5040070f-b9bd-49cc-8984-258e6285b42e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba348b23-d620-437f-a1e6-42324878b776_r4bl72godevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:02 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba348b23-d620-437f-a1e6-42324878b776_r4bl72godevstack@QuobyteHD Jul 24 15:51:02 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:02 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38" returned: 0 in 0.416s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:02 devstack sudo[98960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38 Jul 24 15:51:02 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:02 devstack sudo[98960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba348b23-d620-437f-a1e6-42324878b776_r4bl72godevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:02 devstack sudo[98960]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a.37f2f6e4-6a65-453e-862c-a1da01e04a38" returned: 0 in 0.273s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-37f2f6e4-6a65-453e-862c-a1da01e04a38" released by "_delete_snapshot" :: held 1.665s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.770s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.126s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:02 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] Creating offline snapshot 11e97b37-afa9-4a22-94c9-57128e67bf59 of volume e79ac464-55f2-407f-be0c-afff618b710a {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:51:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584276ad-4898-4e90-82f3-c090896051e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2', 'volume_size': 1, 'source_volid': 'e47a96ac-e093-45c0-aaaa-86da8014ea9a', 'source_volstatus': 'available'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10da6ab8-ae90-44b0-a40b-f6e1284c8e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:02 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a954e25-d359-48f7-ab62-fc417c922f0e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:02 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Volume volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2 (f9fa5633-21d0-4672-86d9-17aa0ac1c9d2): created successfully Jul 24 15:51:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10da6ab8-ae90-44b0-a40b-f6e1284c8e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Flow 'volume_create_manager' (d5d7f0d8-192b-42c2-aeae-fbdc9fbaf75c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:02 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-41e00c57-f871-46ce-82ab-0531485509d9 tempest-VolumesGetTest-1514178004 None] Created volume successfully. Jul 24 15:51:02 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a Jul 24 15:51:02 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:03 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a" returned: 0 in 0.432s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:03 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59 1G Jul 24 15:51:03 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:03 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59 1G" returned: 0 in 0.488s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e79ac464-55f2-407f-be0c-afff618b710a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:03 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e79ac464-55f2-407f-be0c-afff618b710a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59 Jul 24 15:51:03 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:03 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e79ac464-55f2-407f-be0c-afff618b710a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59" returned: 0 in 0.340s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:03 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:51:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:03 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59 Jul 24 15:51:03 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:04 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59" returned: 0 in 0.329s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=138,cinder:INSERT=34,cinder:SELECT=123,cinder:DELETE=7 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=137,cinder:UPDATE=141,cinder:DELETE=11,cinder:INSERT=37 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:04 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.info Jul 24 15:51:04 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:04 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.info" returned: 0 in 0.357s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:04 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:04 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.info Jul 24 15:51:04 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Flow 'volume_create_manager' (6cfb6c4b-7732-4a0e-a23b-9edfcc394629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b1f133-70bd-477f-bce5-13088b30d640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b1f133-70bd-477f-bce5-13088b30d640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1499318250',display_name='tempest-VolumesGetTest-Volume-1781072520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7036ecfe-196f-4932-bfc9-fb4b8265c494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a300571d7b1c477dbfba0e327e5590f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:05Z,use_quota=True,user_id='e189f4de2c924c8289422fc01d64fb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b02984a-2d8a-4068-9968-d81a3b851093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b02984a-2d8a-4068-9968-d81a3b851093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e2370c-432d-4ed3-b395-e6e5184b535c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e2370c-432d-4ed3-b395-e6e5184b535c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7036ecfe-196f-4932-bfc9-fb4b8265c494', 'volume_name': 'volume-7036ecfe-196f-4932-bfc9-fb4b8265c494', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640e59f7-666b-476a-97cf-329da6218cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640e59f7-666b-476a-97cf-329da6218cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b118f7-1415-4846-91a4-4ade72138c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:04 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Volume 7036ecfe-196f-4932-bfc9-fb4b8265c494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7036ecfe-196f-4932-bfc9-fb4b8265c494', 'volume_size': 1} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:04 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.info" returned: 0 in 0.289s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.343s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.665s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1546777924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34edef0e-f882-4dcc-8dcc-88de11bedcf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b498ab30c3c34ec686f3f71ef2083acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:53Z,use_quota=True,user_id='d1ec4c4c1eac4e5fada27303dbd071ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08601bf3-6be5-40c3-b836-3fcaf401b6ef),volume_type_id=08601bf3-6be5-40c3-b836-3fcaf401b6ef)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Creating volume 34edef0e-f882-4dcc-8dcc-88de11bedcf3 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:04 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:51:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:05 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3 1073741824 Jul 24 15:51:05 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:05 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c7d389d1-4835-4731-ab11-567a08b776b3 tempest-GroupSnapshotsTest-1707603888 None] group_snapshot 2854930d-c516-4bc8-bec6-9531f206186a: created successfully Jul 24 15:51:05 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3 1073741824" returned: 0 in 0.490s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:05 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3 Jul 24 15:51:05 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:05 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3" returned: 0 in 0.295s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] <== create_volume: return (827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.004s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1154211992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efce9afd-75dd-468b-b86d-5c700ea05f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b498ab30c3c34ec686f3f71ef2083acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:54Z,use_quota=True,user_id='d1ec4c4c1eac4e5fada27303dbd071ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3f3632a3-5094-4a9c-a20d-ec66aa295a5f),volume_type_id=3f3632a3-5094-4a9c-a20d-ec66aa295a5f)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Creating volume efce9afd-75dd-468b-b86d-5c700ea05f36 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:05 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-efce9afd-75dd-468b-b86d-5c700ea05f36 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:05 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] group_snapshot 2854930d-c516-4bc8-bec6-9531f206186a: deleting Jul 24 15:51:05 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-efce9afd-75dd-468b-b86d-5c700ea05f36 1073741824 Jul 24 15:51:05 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457c5966-2aba-4eb9-8e82-8d4b8149dc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028f63a5-8df6-4742-a024-3e2dfb246622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:05 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Volume volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3 (34edef0e-f882-4dcc-8dcc-88de11bedcf3): created successfully Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028f63a5-8df6-4742-a024-3e2dfb246622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Flow 'volume_create_manager' (4260bd99-14c3-4ee2-a6f7-77e6e881b997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] group_snapshot 2854930d-c516-4bc8-bec6-9531f206186a: deleting {{(pid=88350) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 24 15:51:05 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-8d7c39b5-1680-4002-b364-70c37626729b tempest-TestInstancesWithCinderVolumes-684474430 None] Created volume successfully. Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "cinder-quobyte-e79ac464-55f2-407f-be0c-afff618b710a" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-e79ac464-55f2-407f-be0c-afff618b710a" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "cinder-quobyte-11e97b37-afa9-4a22-94c9-57128e67bf59" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-11e97b37-afa9-4a22-94c9-57128e67bf59" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] Deleting offline snapshot 11e97b37-afa9-4a22-94c9-57128e67bf59 of volume e79ac464-55f2-407f-be0c-afff618b710a {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] snapshot_file for this snap is: volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc0416e-d026-402e-98b8-64871a0ab1bb]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:06 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59 Jul 24 15:51:06 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:06 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-efce9afd-75dd-468b-b86d-5c700ea05f36 1073741824" returned: 0 in 0.590s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-efce9afd-75dd-468b-b86d-5c700ea05f36 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:06 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-efce9afd-75dd-468b-b86d-5c700ea05f36 Jul 24 15:51:06 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:06 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59" returned: 0 in 0.498s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e79ac464-55f2-407f-be0c-afff618b710a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c75d09-aedc-4588-a887-c2e8f6a1d1ac]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:06 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a Jul 24 15:51:06 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:06 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-efce9afd-75dd-468b-b86d-5c700ea05f36" returned: 0 in 0.271s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.425s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1120057268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e651c6-a7e2-438e-8c75-ed9cd7203c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b498ab30c3c34ec686f3f71ef2083acd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:50:54Z,use_quota=True,user_id='d1ec4c4c1eac4e5fada27303dbd071ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb5525b4-afc2-481f-b41c-6dd6be9593b6),volume_type_id=bb5525b4-afc2-481f-b41c-6dd6be9593b6)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Creating volume 94e651c6-a7e2-438e-8c75-ed9cd7203c74 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:06 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:06 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 1073741824 Jul 24 15:51:06 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f74eb46d-bd80-4d00-87d1-a4b6f3d12821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efce9afd-75dd-468b-b86d-5c700ea05f36', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442b1171-bf44-4b39-a490-c81864d52f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:06 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Volume volume-efce9afd-75dd-468b-b86d-5c700ea05f36 (efce9afd-75dd-468b-b86d-5c700ea05f36): created successfully Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442b1171-bf44-4b39-a490-c81864d52f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:06 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Flow 'volume_create_manager' (acacbfea-402b-4509-af04-6b28e969dc6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:06 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d3993398-20f9-4f02-90e7-ef550bb70ec2 tempest-TestInstancesWithCinderVolumes-684474430 None] Created volume successfully. Jul 24 15:51:07 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a" returned: 0 in 0.411s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:07 devstack sudo[99020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59 Jul 24 15:51:07 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:07 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 1073741824" returned: 0 in 0.575s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:07 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 Jul 24 15:51:07 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:07 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59" returned: 0 in 0.412s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:07 devstack sudo[99032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59 Jul 24 15:51:07 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:07 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74" returned: 0 in 0.320s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.836s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1499318250',display_name='tempest-VolumesGetTest-Volume-1781072520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7036ecfe-196f-4932-bfc9-fb4b8265c494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a300571d7b1c477dbfba0e327e5590f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:05Z,use_quota=True,user_id='e189f4de2c924c8289422fc01d64fb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Creating volume 7036ecfe-196f-4932-bfc9-fb4b8265c494 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:07 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7036ecfe-196f-4932-bfc9-fb4b8265c494 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:07 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7036ecfe-196f-4932-bfc9-fb4b8265c494 1073741824 Jul 24 15:51:07 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:07 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a.11e97b37-afa9-4a22-94c9-57128e67bf59" returned: 0 in 0.322s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Attempting download of ba348b23-d620-437f-a1e6-42324878b776 ((None, [{'url': 'file:///opt/stack/data/glance/images/ba348b23-d620-437f-a1e6-42324878b776', 'metadata': {}}])) to volume 94e651c6-a7e2-438e-8c75-ed9cd7203c74. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-11e97b37-afa9-4a22-94c9-57128e67bf59" released by "_delete_snapshot" :: held 1.810s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-e79ac464-55f2-407f-be0c-afff618b710a" released by "delete_snapshot" :: held 1.843s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6df5b4-077f-4ec7-b390-6f6ab1f54660]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba348b23-d620-437f-a1e6-42324878b776_zi93or8a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:07 devstack cinder-volume[88350]: WARNING cinder.quota [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1833434526 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1833434526, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:51:07 devstack cinder-volume[88350]: WARNING cinder.quota [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1833434526 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1833434526, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:51:07 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] Created reservations ['a7e7c955-3162-4327-bb91-0d3725612923', '125904ff-3a7c-4937-8fcf-b7c0f4714192', '24e9246b-8767-4880-bf6c-6cb76c621747', '5e250151-05fa-4878-ba0f-9cee883191fa'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:08 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba348b23-d620-437f-a1e6-42324878b776_zi93or8a Jul 24 15:51:08 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:08 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d12c0294-f9de-415e-9332-31f5cb537177 tempest-GroupSnapshotsTest-1707603888 None] group_snapshot 2854930d-c516-4bc8-bec6-9531f206186a: deleted successfully Jul 24 15:51:08 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:08 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ba348b23-d620-437f-a1e6-42324878b776_zi93or8a" returned: 0 in 0.424s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba348b23-d620-437f-a1e6-42324878b776_zi93or8a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7036ecfe-196f-4932-bfc9-fb4b8265c494 1073741824" returned: 0 in 0.594s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7036ecfe-196f-4932-bfc9-fb4b8265c494 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:08 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7036ecfe-196f-4932-bfc9-fb4b8265c494 Jul 24 15:51:08 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:08 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba348b23-d620-437f-a1e6-42324878b776_zi93or8a Jul 24 15:51:08 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "cinder-quobyte-e79ac464-55f2-407f-be0c-afff618b710a" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:08 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba348b23-d620-437f-a1e6-42324878b776_zi93or8a" returned: 1 in 0.385s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ba348b23-d620-437f-a1e6-42324878b776_zi93or8a' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c817cf-db94-40c1-8eaa-aa957de2b92b]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-e79ac464-55f2-407f-be0c-afff618b710a" acquired by "delete_volume" :: waited 0.047s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:08 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba348b23-d620-437f-a1e6-42324878b776_r4bl72godevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2e2a36-6f77-42b5-84f9-b5c7d78e4b0d]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7036ecfe-196f-4932-bfc9-fb4b8265c494" returned: 0 in 0.436s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b118f7-1415-4846-91a4-4ade72138c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7036ecfe-196f-4932-bfc9-fb4b8265c494', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95819574-68ab-495b-88cc-0b98979d055c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:08 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Volume volume-7036ecfe-196f-4932-bfc9-fb4b8265c494 (7036ecfe-196f-4932-bfc9-fb4b8265c494): created successfully Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95819574-68ab-495b-88cc-0b98979d055c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Flow 'volume_create_manager' (6cfb6c4b-7732-4a0e-a23b-9edfcc394629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:08 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c9f5ee56-993d-4817-beab-11407641eb90 tempest-VolumesGetTest-1514178004 None] Created volume successfully. Jul 24 15:51:08 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba348b23-d620-437f-a1e6-42324878b776_r4bl72godevstack@QuobyteHD Jul 24 15:51:08 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:08 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a Jul 24 15:51:08 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:09 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ba348b23-d620-437f-a1e6-42324878b776_r4bl72godevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] ba348b23-d620-437f-a1e6-42324878b776 was qcow2, converting to qcow2 {{(pid=88350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ba348b23-d620-437f-a1e6-42324878b776_r4bl72godevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-7036ecfe-196f-4932-bfc9-fb4b8265c494-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:09 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ba348b23-d620-437f-a1e6-42324878b776_r4bl72godevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 Jul 24 15:51:09 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Lock "cinder-7036ecfe-196f-4932-bfc9-fb4b8265c494-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-quobyte-7036ecfe-196f-4932-bfc9-fb4b8265c494" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-7036ecfe-196f-4932-bfc9-fb4b8265c494" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc78e211-2c1e-488e-b28e-1e868c505862]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7036ecfe-196f-4932-bfc9-fb4b8265c494 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:09 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a" returned: 0 in 0.609s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:09 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a Jul 24 15:51:09 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:09 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7036ecfe-196f-4932-bfc9-fb4b8265c494 Jul 24 15:51:09 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:09 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e79ac464-55f2-407f-be0c-afff618b710a" returned: 0 in 0.265s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Lock "cinder-quobyte-e79ac464-55f2-407f-be0c-afff618b710a" released by "delete_volume" :: held 0.984s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Created reservations ['3ecbce78-ca24-4402-a711-50efd1deab13'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:09 devstack cinder-volume[88350]: WARNING cinder.quota [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1833434526 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1833434526, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Created reservations ['e590c0e9-4bc1-4b54-8743-f2db6284ed04', '55f47b73-168d-4b1b-9c63-0f4f55e12a62', '31dad52b-3e2c-4699-95a6-83a43b0eadc5', 'f26a5435-2d59-4096-9030-be423a452c2d'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:09 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7036ecfe-196f-4932-bfc9-fb4b8265c494" returned: 0 in 0.497s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7036ecfe-196f-4932-bfc9-fb4b8265c494 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:09 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7036ecfe-196f-4932-bfc9-fb4b8265c494 Jul 24 15:51:09 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:10 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:51:10 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:10 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7036ecfe-196f-4932-bfc9-fb4b8265c494" returned: 0 in 0.336s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-7036ecfe-196f-4932-bfc9-fb4b8265c494" released by "delete_volume" :: held 0.892s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Created reservations ['5edead5c-35ca-4aad-a705-1b6c806e2ec9', 'c4f83c42-1d54-4613-b1f3-50f1247cceb9', 'ca53ff63-e09b-4724-81a2-f8b07a3c89a7', '4fa36e4d-0425-4ac5-966b-d82d0a87e5fe'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:10 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.361s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:10 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-661ef058-2e33-4d03-9c94-c966820bca8d tempest-GroupSnapshotsTest-1707603888 None] Delete group completed successfully. Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:10 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:51:10 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:10 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.263s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:10 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Deleted volume successfully. Jul 24 15:51:10 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3dd25ff5-543a-462b-b086-8d58999430cd tempest-VolumesGetTest-1514178004 None] Lock "cinder-7036ecfe-196f-4932-bfc9-fb4b8265c494-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:11 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ba348b23-d620-437f-a1e6-42324878b776_r4bl72godevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74" returned: 0 in 2.287s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:11 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ba348b23-d620-437f-a1e6-42324878b776_r4bl72godevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:51:11 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Converted 112.00 MB image at 48.94 MB/s Jul 24 15:51:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:11 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 1G Jul 24 15:51:11 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Lock "cinder-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-quobyte-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:11 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[26738a97-14aa-46ef-9dc2-142520e4c265]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:11 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2 Jul 24 15:51:11 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Flow 'volume_create_manager' (eac2dc27-0aff-40ba-88f6-e485a0c9c0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:12 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83defb0-6657-48f3-82c6-f6e8a4b11092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 1G" returned: 0 in 0.576s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Downloaded image ba348b23-d620-437f-a1e6-42324878b776 ((None, [{'url': 'file:///opt/stack/data/glance/images/ba348b23-d620-437f-a1e6-42324878b776', 'metadata': {}}])) to volume 94e651c6-a7e2-438e-8c75-ed9cd7203c74 successfully. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Temporary image ba348b23-d620-437f-a1e6-42324878b776 for user d1ec4c4c1eac4e5fada27303dbd071ea is deleted. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Marking volume 94e651c6-a7e2-438e-8c75-ed9cd7203c74 as bootable. {{(pid=88350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83defb0-6657-48f3-82c6-f6e8a4b11092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-715407059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e253e9ed-0bc9-467e-936f-92cf5ac31dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f6a36677744a369090209674ab3111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:12Z,use_quota=True,user_id='6d0804b4eb0e40e998789d908b16e3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae21888-e6ea-4275-869b-c914131a7459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ae21888-e6ea-4275-869b-c914131a7459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cffec0a0-756d-4357-9836-8a397fa81bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cffec0a0-756d-4357-9836-8a397fa81bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e253e9ed-0bc9-467e-936f-92cf5ac31dab', 'volume_name': 'volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b4729f-2a41-48ba-ae25-d3463ee8bd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b4729f-2a41-48ba-ae25-d3463ee8bd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f53f785-21f4-4e3a-9504-4137ad752d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:12 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Volume e253e9ed-0bc9-467e-936f-92cf5ac31dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab', 'volume_size': 1} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-715407059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e253e9ed-0bc9-467e-936f-92cf5ac31dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1f6a36677744a369090209674ab3111',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:12Z,use_quota=True,user_id='6d0804b4eb0e40e998789d908b16e3e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Creating volume e253e9ed-0bc9-467e-936f-92cf5ac31dab {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:12 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Copying metadata from image ba348b23-d620-437f-a1e6-42324878b776 to 94e651c6-a7e2-438e-8c75-ed9cd7203c74. {{(pid=88350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Creating volume glance metadata for volume 94e651c6-a7e2-438e-8c75-ed9cd7203c74 backed by image ba348b23-d620-437f-a1e6-42324878b776 with: {'image_id': 'ba348b23-d620-437f-a1e6-42324878b776', 'image_name': 'tempest-scenario-img--770637047', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:51:12 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab 1073741824 Jul 24 15:51:12 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b23ddc6-2fa0-4b49-b388-12d068c76b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74', 'volume_size': 1, 'image_id': 'ba348b23-d620-437f-a1e6-42324878b776', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ba348b23-d620-437f-a1e6-42324878b776', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--770637047', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b498ab30c3c34ec686f3f71ef2083acd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ba348b23-d620-437f-a1e6-42324878b776', 'created_at': datetime.datetime(2026, 7, 24, 13, 50, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 50, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ba348b23-d620-437f-a1e6-42324878b776/file', 'properties': {}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdd9598-1aeb-4040-9f72-dd9b3a2d683d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:12 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Volume volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 (94e651c6-a7e2-438e-8c75-ed9cd7203c74): created successfully Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abdd9598-1aeb-4040-9f72-dd9b3a2d683d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Flow 'volume_create_manager' (f2050335-a784-471e-b447-d2615acb3635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:12 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-dc040590-3112-4e92-90c2-2d81e78a9fce tempest-TestInstancesWithCinderVolumes-684474430 None] Created volume successfully. Jul 24 15:51:12 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2" returned: 0 in 0.493s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:12 devstack sudo[99102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2 Jul 24 15:51:12 devstack sudo[99102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:12 devstack sudo[99102]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2" returned: 0 in 0.279s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2" released by "delete_volume" :: held 0.849s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:12 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab 1073741824" returned: 0 in 0.529s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Created reservations ['4b651f78-ea53-4ffa-b848-afbd4a0165be', '58991cc8-0dfb-44b1-853e-a9a783777527', '7187c54d-6cd6-4bfd-8acd-7594b707cda7', '6eabae6b-ccea-4b43-920c-a73078f2df45'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:12 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab Jul 24 15:51:12 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:12 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:51:12 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-e47a96ac-e093-45c0-aaaa-86da8014ea9a-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Lock "cinder-e47a96ac-e093-45c0-aaaa-86da8014ea9a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-quobyte-e47a96ac-e093-45c0-aaaa-86da8014ea9a" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-e47a96ac-e093-45c0-aaaa-86da8014ea9a" acquired by "delete_volume" :: waited 0.032s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:13 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab" returned: 0 in 0.464s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:13 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da7ee4c-9c0c-49a9-b042-0389103956a7]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.431s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f53f785-21f4-4e3a-9504-4137ad752d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2936fec-9cbd-4a23-8852-805d9b481f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:13 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Deleted volume successfully. Jul 24 15:51:13 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Volume volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab (e253e9ed-0bc9-467e-936f-92cf5ac31dab): created successfully Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2936fec-9cbd-4a23-8852-805d9b481f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Flow 'volume_create_manager' (eac2dc27-0aff-40ba-88f6-e485a0c9c0a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7002102e-b7e3-4b60-8c6c-6cca61705bd1 tempest-VolumesGetTest-1514178004 None] Lock "cinder-f9fa5633-21d0-4672-86d9-17aa0ac1c9d2-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:13 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c3721597-6db7-47fa-83b6-b8fa5fc5d36f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Created volume successfully. Jul 24 15:51:13 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a Jul 24 15:51:13 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:13 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a" returned: 0 in 0.483s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:13 devstack sudo[99121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a Jul 24 15:51:13 devstack sudo[99121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:13 devstack sudo[99121]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e47a96ac-e093-45c0-aaaa-86da8014ea9a" returned: 0 in 0.293s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-e47a96ac-e093-45c0-aaaa-86da8014ea9a" released by "delete_volume" :: held 0.882s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:14 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Created reservations ['b69fece6-095f-48ed-8f60-df08b5665550', '02342553-e9aa-44d4-971e-7b3dc2f6ff65', 'bc9a2d4e-065e-4a7c-8afe-07e836031b3f', 'c0caa741-c5e1-4902-a4fe-1b03add8ae1e'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:14 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:51:14 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:14 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.390s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:14 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:14 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Deleted volume successfully. Jul 24 15:51:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2adf9063-13b8-4062-a70b-5ad49fc07010 tempest-VolumesGetTest-1514178004 None] Lock "cinder-e47a96ac-e093-45c0-aaaa-86da8014ea9a-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:15 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Acquiring lock "cinder-e253e9ed-0bc9-467e-936f-92cf5ac31dab-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:15 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Lock "cinder-e253e9ed-0bc9-467e-936f-92cf5ac31dab-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:15 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Acquiring lock "cinder-quobyte-e253e9ed-0bc9-467e-936f-92cf5ac31dab" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:15 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Lock "cinder-quobyte-e253e9ed-0bc9-467e-936f-92cf5ac31dab" acquired by "delete_volume" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:15 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd56bde4-a11d-49a4-bae6-aed228bee411]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:15 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab Jul 24 15:51:15 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:16 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab" returned: 0 in 0.568s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:16 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab Jul 24 15:51:16 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:16 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Flow 'volume_create_manager' (347b8f3f-9395-4add-b18c-b54cc3313e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2da69c-e682-41b6-ba1d-03f9e47c3929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2da69c-e682-41b6-ba1d-03f9e47c3929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1162478110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ae385a-ca9d-4511-9614-e25d339b396f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a300571d7b1c477dbfba0e327e5590f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:16Z,use_quota=True,user_id='e189f4de2c924c8289422fc01d64fb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2c6772-f16a-4bfc-bbc6-bfc7b2250e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2c6772-f16a-4bfc-bbc6-bfc7b2250e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb23ab0-0934-4e2a-85fa-5d4a3184babb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:16 devstack cinder-volume[88350]: DEBUG cinder.image.glance [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Creating Keystone auth plugin from conf {{(pid=88350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:51:16 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e253e9ed-0bc9-467e-936f-92cf5ac31dab" returned: 0 in 0.364s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Lock "cinder-quobyte-e253e9ed-0bc9-467e-936f-92cf5ac31dab" released by "delete_volume" :: held 1.027s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:16 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Created reservations ['f24e4964-563e-4cba-8fa5-e929f49d01bc', 'fcfb58b5-e1da-470d-9922-9ade4176e60c', '52d597a6-ed5a-4fde-866c-1eb215c1eec7', '3b08caaf-a868-495e-bf51-41122be49a03'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-d19e99ca-4a5e-4f2e-8d46-1a2737fe3fcb req-32c0a5f1-2719-4a85-af20-15946201de63 tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-d19e99ca-4a5e-4f2e-8d46-1a2737fe3fcb req-32c0a5f1-2719-4a85-af20-15946201de63 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-d19e99ca-4a5e-4f2e-8d46-1a2737fe3fcb req-32c0a5f1-2719-4a85-af20-15946201de63 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:17 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:51:17 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-d19e99ca-4a5e-4f2e-8d46-1a2737fe3fcb req-32c0a5f1-2719-4a85-af20-15946201de63 tempest-TestInstancesWithCinderVolumes-684474430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12e6aac5-d47c-4d91-9331-7eab7b73fc76', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:51:17 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-d19e99ca-4a5e-4f2e-8d46-1a2737fe3fcb req-32c0a5f1-2719-4a85-af20-15946201de63 tempest-TestInstancesWithCinderVolumes-684474430 None] attachment_update completed successfully. Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb23ab0-0934-4e2a-85fa-5d4a3184babb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '50ae385a-ca9d-4511-9614-e25d339b396f', 'volume_name': 'volume-50ae385a-ca9d-4511-9614-e25d339b396f', 'volume_size': 1, 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'df66204cc96f42be98c9c3c0564f8276', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'created_at': datetime.datetime(2026, 7, 24, 13, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a91d37-83e9-4d32-877c-f1364fa3cdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a91d37-83e9-4d32-877c-f1364fa3cdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa85ca30-08e2-4c62-9d9f-3a2f0c4f084d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:17 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Volume 50ae385a-ca9d-4511-9614-e25d339b396f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-50ae385a-ca9d-4511-9614-e25d339b396f', 'volume_size': 1, 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'df66204cc96f42be98c9c3c0564f8276', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'created_at': datetime.datetime(2026, 7, 24, 13, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Trying to clone 50ae385a-ca9d-4511-9614-e25d339b396f from image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]). {{(pid=88350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:51:17 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.486s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:17 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Deleted volume successfully. Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29c0cc62-a0a4-453e-b228-92be58a8ad0f tempest-VolumeQuotasNegativeTestJSON-2130227001 None] Lock "cinder-e253e9ed-0bc9-467e-936f-92cf5ac31dab-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_hh2h74v1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:51:17 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Image download 20.69 MB at 20.69 MB/s Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d067790-78ef-4abe-85f9-63610c11a97e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_hh2h74v1devstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:18 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_hh2h74v1devstack@QuobyteHD Jul 24 15:51:18 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:18 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_hh2h74v1devstack@QuobyteHD" returned: 0 in 0.440s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Temporary image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 is fetched for user e189f4de2c924c8289422fc01d64fb50. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a183a5f8-84b3-406e-87cd-29e28626c201]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_hh2h74v1devstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:18 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c5e8920b-0b96-4a1a-b640-c612b76c13d2 tempest-GroupsV314Test-875412980 None] Group tempest-GroupsV314Test-Group-110292007: creating Jul 24 15:51:18 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_hh2h74v1devstack@QuobyteHD Jul 24 15:51:18 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:18 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c5e8920b-0b96-4a1a-b640-c612b76c13d2 tempest-GroupsV314Test-875412980 None] Group tempest-GroupsV314Test-Group-110292007: created successfully Jul 24 15:51:18 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c5e8920b-0b96-4a1a-b640-c612b76c13d2 tempest-GroupsV314Test-875412980 None] Create group completed successfully. Jul 24 15:51:18 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_hh2h74v1devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1162478110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ae385a-ca9d-4511-9614-e25d339b396f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a300571d7b1c477dbfba0e327e5590f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:16Z,use_quota=True,user_id='e189f4de2c924c8289422fc01d64fb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Creating volume 50ae385a-ca9d-4511-9614-e25d339b396f {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:18 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:51:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:18 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f 1073741824 Jul 24 15:51:18 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:19 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f 1073741824" returned: 0 in 0.677s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:19 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f Jul 24 15:51:19 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:19 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f" returned: 0 in 0.318s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Attempting download of 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}])) to volume 50ae385a-ca9d-4511-9614-e25d339b396f. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3438a5-e7ab-43c4-81d4-e80520dccc19]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_i0jnbthz {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:20 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_i0jnbthz Jul 24 15:51:20 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Flow 'volume_create_manager' (38b0ae10-4dd6-438f-b701-3803f1c2a7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b86c32-a60e-43eb-ab34-8cdaef63e714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b86c32-a60e-43eb-ab34-8cdaef63e714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1414923741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ccc68e96-440b-4ee1-ac7d-c87ade07ded9,host='devstack@QuobyteHD#QuobyteHD',id=606b9c89-2f68-4776-9100-aafc64e08ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5415b790080b4a8189d572878c943b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:21Z,use_quota=True,user_id='5a304067a65b4855bb2aa600473545e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7910fdbd-540f-4313-a197-63ecd07ea88c),volume_type_id=7910fdbd-540f-4313-a197-63ecd07ea88c)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fee9e7f-cdbb-4f6f-b2ac-52048d5bfe9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fee9e7f-cdbb-4f6f-b2ac-52048d5bfe9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53895fc6-bb4f-4712-b051-88fa0531c99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53895fc6-bb4f-4712-b051-88fa0531c99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '606b9c89-2f68-4776-9100-aafc64e08ae5', 'volume_name': 'volume-606b9c89-2f68-4776-9100-aafc64e08ae5', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d913749c-84d8-4ba6-acbc-4d1b4557a4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:20 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d913749c-84d8-4ba6-acbc-4d1b4557a4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580c91bc-bb31-46c7-8d33-92d7b7376ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:20 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Volume 606b9c89-2f68-4776-9100-aafc64e08ae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-606b9c89-2f68-4776-9100-aafc64e08ae5', 'volume_size': 1} Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ccc68e96-440b-4ee1-ac7d-c87ade07ded9,created_at=2026-07-24T13:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1414923741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ccc68e96-440b-4ee1-ac7d-c87ade07ded9,host='devstack@QuobyteHD#QuobyteHD',id=606b9c89-2f68-4776-9100-aafc64e08ae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5415b790080b4a8189d572878c943b0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:21Z,use_quota=True,user_id='5a304067a65b4855bb2aa600473545e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7910fdbd-540f-4313-a197-63ecd07ea88c),volume_type_id=7910fdbd-540f-4313-a197-63ecd07ea88c)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Creating volume 606b9c89-2f68-4776-9100-aafc64e08ae5 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:21 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_i0jnbthz" returned: 0 in 0.858s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_i0jnbthz {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:21 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 1073741824 Jul 24 15:51:21 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:21 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_i0jnbthz Jul 24 15:51:21 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:21 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_i0jnbthz" returned: 1 in 0.817s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_i0jnbthz' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4316781e-f346-400b-b397-6a6aef29fa8b]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_hh2h74v1devstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:21 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 1073741824" returned: 0 in 0.880s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:22 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 Jul 24 15:51:22 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:22 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_hh2h74v1devstack@QuobyteHD Jul 24 15:51:22 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:22 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_hh2h74v1devstack@QuobyteHD" returned: 0 in 0.463s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:22 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 was qcow2, converting to qcow2 {{(pid=88350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:51:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_hh2h74v1devstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:22 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5" returned: 0 in 0.414s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580c91bc-bb31-46c7-8d33-92d7b7376ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-606b9c89-2f68-4776-9100-aafc64e08ae5', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:22 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_hh2h74v1devstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f Jul 24 15:51:22 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55d91f5-ffbc-4ec5-a03d-b96077599a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:22 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Volume volume-606b9c89-2f68-4776-9100-aafc64e08ae5 (606b9c89-2f68-4776-9100-aafc64e08ae5): created successfully Jul 24 15:51:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55d91f5-ffbc-4ec5-a03d-b96077599a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Flow 'volume_create_manager' (38b0ae10-4dd6-438f-b701-3803f1c2a7bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:22 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-92211e7a-5255-48b3-bb6d-c873e83e89f5 tempest-GroupsV314Test-875412980 None] Created volume successfully. Jul 24 15:51:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:23 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Cloning volume 606b9c89-2f68-4776-9100-aafc64e08ae5 to volume 922e47e3-e60f-4cd2-8e88-adf1823920f2 Jul 24 15:51:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Creating offline snapshot cbf58761-a615-45de-ac67-6832f85aab0d of volume 606b9c89-2f68-4776-9100-aafc64e08ae5 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:51:24 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[76111b5b-8e71-450f-a70c-243319ca526c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:24 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 Jul 24 15:51:24 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:24 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5" returned: 0 in 0.830s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:24 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d 1G Jul 24 15:51:24 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:25 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_hh2h74v1devstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f" returned: 0 in 3.000s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:25 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_hh2h74v1devstack@QuobyteHD, size 112.00 MB, duration 3.00 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:51:25 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Converted 112.00 MB image at 37.32 MB/s Jul 24 15:51:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:25 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f 1G Jul 24 15:51:25 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:25 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d 1G" returned: 0 in 0.902s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-606b9c89-2f68-4776-9100-aafc64e08ae5 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:25 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-606b9c89-2f68-4776-9100-aafc64e08ae5 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d Jul 24 15:51:25 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:25 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f 1G" returned: 0 in 0.634s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:25 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Downloaded image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}])) to volume 50ae385a-ca9d-4511-9614-e25d339b396f successfully. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:51:26 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Temporary image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 for user e189f4de2c924c8289422fc01d64fb50 is deleted. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:51:26 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Marking volume 50ae385a-ca9d-4511-9614-e25d339b396f as bootable. {{(pid=88350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:51:26 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Copying metadata from image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 to 50ae385a-ca9d-4511-9614-e25d339b396f. {{(pid=88350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:51:26 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Creating volume glance metadata for volume 50ae385a-ca9d-4511-9614-e25d339b396f backed by image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:51:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa85ca30-08e2-4c62-9d9f-3a2f0c4f084d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ae385a-ca9d-4511-9614-e25d339b396f', 'volume_size': 1, 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'df66204cc96f42be98c9c3c0564f8276', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'created_at': datetime.datetime(2026, 7, 24, 13, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b7aa03-215f-4b6b-b0e5-f1c05199ffcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:26 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Volume volume-50ae385a-ca9d-4511-9614-e25d339b396f (50ae385a-ca9d-4511-9614-e25d339b396f): created successfully Jul 24 15:51:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b7aa03-215f-4b6b-b0e5-f1c05199ffcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Flow 'volume_create_manager' (347b8f3f-9395-4add-b18c-b54cc3313e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:26 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c4c75e83-6a77-45cf-9a74-371b03aa2579 tempest-VolumesGetTest-1514178004 None] Created volume successfully. Jul 24 15:51:26 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-606b9c89-2f68-4776-9100-aafc64e08ae5 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d" returned: 0 in 0.593s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:26 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:51:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:26 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d Jul 24 15:51:26 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:26 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d" returned: 0 in 0.546s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:27 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.info Jul 24 15:51:27 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:27 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.info" returned: 0 in 0.524s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:27 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.info is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:51:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:27 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.info Jul 24 15:51:27 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:27 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Flow 'volume_create_manager' (7fabbf4b-9e40-486b-9406-6d87475fa296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbab51e-6759-4d4f-bc01-35ebff72f9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:27 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.info" returned: 0 in 0.407s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Acquiring lock "cinder-quobyte-922e47e3-e60f-4cd2-8e88-adf1823920f2" by "_copy_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cbab51e-6759-4d4f-bc01-35ebff72f9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-163517102',display_name='tempest-VolumesGetTest-Volume-1093285894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f003af74-c7d8-4cbe-8e24-f5360d75bab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a300571d7b1c477dbfba0e327e5590f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:28Z,use_quota=True,user_id='e189f4de2c924c8289422fc01d64fb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ab977e-065b-4ea8-833d-6df74b678591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ab977e-065b-4ea8-833d-6df74b678591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53706d3-ab8d-4da1-8a0b-833105a1fe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53706d3-ab8d-4da1-8a0b-833105a1fe16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f003af74-c7d8-4cbe-8e24-f5360d75bab0', 'volume_name': 'volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928f67df-3ff6-4fa7-9ba5-0137a1e085ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928f67df-3ff6-4fa7-9ba5-0137a1e085ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03801536-bcbb-4900-a44a-7a9eca7bde4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:28 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Volume f003af74-c7d8-4cbe-8e24-f5360d75bab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0', 'volume_size': 1} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Lock "cinder-quobyte-922e47e3-e60f-4cd2-8e88-adf1823920f2" acquired by "_copy_volume_from_snapshot" :: waited 0.105s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] snapshot: cbf58761-a615-45de-ac67-6832f85aab0d, volume: 922e47e3-e60f-4cd2-8e88-adf1823920f2, {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6641ea8b-e290-43b0-9e9c-e16a74905ff5]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:28 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d Jul 24 15:51:28 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Flow 'volume_create_manager' (9f1e1be7-c489-4b4e-a6c7-3339390711ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df78765c-ff6a-452f-bf11-4ac0aa5627d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:28 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df78765c-ff6a-452f-bf11-4ac0aa5627d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1459367814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302d7c2a-95e1-4bae-a435-26fd183dbc18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8dfff7509742169fb4cb9a68009ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:29Z,use_quota=True,user_id='137e6bc732a24929818434c6468d2c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eab3954-74b6-43bd-bd2e-6afdeca367de),volume_type_id=2eab3954-74b6-43bd-bd2e-6afdeca367de)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b9ac8b-5269-4088-8b09-434f3d5b6095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b9ac8b-5269-4088-8b09-434f3d5b6095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee175db-0023-48b3-9b0f-d919bd6c77d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee175db-0023-48b3-9b0f-d919bd6c77d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '302d7c2a-95e1-4bae-a435-26fd183dbc18', 'volume_name': 'volume-302d7c2a-95e1-4bae-a435-26fd183dbc18', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c72fa2e-6677-437e-83e8-4d223dd305a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c72fa2e-6677-437e-83e8-4d223dd305a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800890df-4021-41c4-b738-d4a6deece328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:28 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Volume 302d7c2a-95e1-4bae-a435-26fd183dbc18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-302d7c2a-95e1-4bae-a435-26fd183dbc18', 'volume_size': 1} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d" returned: 0 in 0.664s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-606b9c89-2f68-4776-9100-aafc64e08ae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Creating direct copy from snapshot {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4c0d35-74a6-4fc4-9feb-62f11a3648c5]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:28 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 Jul 24 15:51:28 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:29 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5" returned: 0 in 0.489s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:29 devstack cinder-volume[88350]: DEBUG cinder.utils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Path /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-922e47e3-e60f-4cd2-8e88-adf1823920f2 not found in is_blk_device check {{(pid=88350) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:51:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-922e47e3-e60f-4cd2-8e88-adf1823920f2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:29 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-922e47e3-e60f-4cd2-8e88-adf1823920f2 Jul 24 15:51:29 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:36 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-922e47e3-e60f-4cd2-8e88-adf1823920f2" returned: 0 in 7.466s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:36 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f564ea83-29c9-457b-aa9d-3fc1c3ad2f7a]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:36 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 Jul 24 15:51:36 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:37 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5" returned: 0 in 0.603s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:37 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Image conversion details: src /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5, size 1024.00 MB, duration 7.47 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-922e47e3-e60f-4cd2-8e88-adf1823920f2 {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:51:37 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Converted 1024.00 MB image at 137.11 MB/s Jul 24 15:51:37 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-922e47e3-e60f-4cd2-8e88-adf1823920f2 is being set with open permissions: ugo+rw: NotImplementedError Jul 24 15:51:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-922e47e3-e60f-4cd2-8e88-adf1823920f2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:37 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-922e47e3-e60f-4cd2-8e88-adf1823920f2 Jul 24 15:51:37 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:37 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-922e47e3-e60f-4cd2-8e88-adf1823920f2" returned: 0 in 0.373s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Lock "cinder-quobyte-922e47e3-e60f-4cd2-8e88-adf1823920f2" released by "_copy_volume_from_snapshot" :: held 9.702s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Acquiring lock "cinder-quobyte-cbf58761-a615-45de-ac67-6832f85aab0d" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Lock "cinder-quobyte-cbf58761-a615-45de-ac67-6832f85aab0d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Deleting offline snapshot cbf58761-a615-45de-ac67-6832f85aab0d of volume 606b9c89-2f68-4776-9100-aafc64e08ae5 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:51:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] snapshot_file for this snap is: volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:51:37 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[60137363-f87c-452a-b60c-9a730c788900]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:38 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d Jul 24 15:51:38 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:38 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d" returned: 0 in 0.400s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-606b9c89-2f68-4776-9100-aafc64e08ae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:51:38 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[10be9e8c-b437-47dc-8a09-ef98b5d218fd]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:38 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 Jul 24 15:51:38 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:38 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5" returned: 0 in 0.372s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:38 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d Jul 24 15:51:38 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:38 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=77,cinder:INSERT=29,cinder:UPDATE=80,cinder:DELETE=5 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:51:39 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d" returned: 0 in 0.369s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:39 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d Jul 24 15:51:39 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:39 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5.cbf58761-a615-45de-ac67-6832f85aab0d" returned: 0 in 0.260s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Lock "cinder-quobyte-cbf58761-a615-45de-ac67-6832f85aab0d" released by "_delete_snapshot" :: held 1.518s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.423s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.293s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-163517102',display_name='tempest-VolumesGetTest-Volume-1093285894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f003af74-c7d8-4cbe-8e24-f5360d75bab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a300571d7b1c477dbfba0e327e5590f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:28Z,use_quota=True,user_id='e189f4de2c924c8289422fc01d64fb50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Creating volume f003af74-c7d8-4cbe-8e24-f5360d75bab0 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:39 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:39 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0 1073741824 Jul 24 15:51:39 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:39 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f60cf440-f886-4f12-95d9-703af106d6f9 tempest-GroupsV314Test-875412980 None] Create group from source-group-ccc68e96-440b-4ee1-ac7d-c87ade07ded9 completed successfully. Jul 24 15:51:39 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0 1073741824" returned: 0 in 0.448s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:39 devstack sudo[99764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0 Jul 24 15:51:39 devstack sudo[99764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:40 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:51:40 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:40 devstack sudo[99764]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0" returned: 0 in 0.296s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.363s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1459367814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=302d7c2a-95e1-4bae-a435-26fd183dbc18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a8dfff7509742169fb4cb9a68009ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:29Z,use_quota=True,user_id='137e6bc732a24929818434c6468d2c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2eab3954-74b6-43bd-bd2e-6afdeca367de),volume_type_id=2eab3954-74b6-43bd-bd2e-6afdeca367de)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Creating volume 302d7c2a-95e1-4bae-a435-26fd183dbc18 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:40 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-302d7c2a-95e1-4bae-a435-26fd183dbc18 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03801536-bcbb-4900-a44a-7a9eca7bde4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1380e93e-a9b2-48d3-b21f-9e681aae002a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:40 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-302d7c2a-95e1-4bae-a435-26fd183dbc18 1073741824 Jul 24 15:51:40 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:40 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Volume volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0 (f003af74-c7d8-4cbe-8e24-f5360d75bab0): created successfully Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1380e93e-a9b2-48d3-b21f-9e681aae002a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Flow 'volume_create_manager' (7fabbf4b-9e40-486b-9406-6d87475fa296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:40 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a3991659-7c6f-41b4-b228-dd9469eebbcf tempest-VolumesGetTest-1514178004 None] Created volume successfully. Jul 24 15:51:40 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.409s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-f003af74-c7d8-4cbe-8e24-f5360d75bab0-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Lock "cinder-f003af74-c7d8-4cbe-8e24-f5360d75bab0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Acquiring lock "cinder-quobyte-922e47e3-e60f-4cd2-8e88-adf1823920f2" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-quobyte-f003af74-c7d8-4cbe-8e24-f5360d75bab0" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-f003af74-c7d8-4cbe-8e24-f5360d75bab0" acquired by "delete_volume" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Lock "cinder-quobyte-922e47e3-e60f-4cd2-8e88-adf1823920f2" acquired by "delete_volume" :: waited 0.044s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc86a2fd-70ae-43c8-abdd-6256a2a4a5df]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb424e3-189c-443b-8e10-988384b4f627]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-922e47e3-e60f-4cd2-8e88-adf1823920f2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:40 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-302d7c2a-95e1-4bae-a435-26fd183dbc18 1073741824" returned: 0 in 0.741s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-302d7c2a-95e1-4bae-a435-26fd183dbc18 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:40 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0 Jul 24 15:51:40 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:41 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-922e47e3-e60f-4cd2-8e88-adf1823920f2 Jul 24 15:51:41 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:41 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-302d7c2a-95e1-4bae-a435-26fd183dbc18 Jul 24 15:51:41 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:41 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-302d7c2a-95e1-4bae-a435-26fd183dbc18" returned: 0 in 0.318s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (800890df-4021-41c4-b738-d4a6deece328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-302d7c2a-95e1-4bae-a435-26fd183dbc18', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57896c35-0691-46c7-9377-8effda211811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:41 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-922e47e3-e60f-4cd2-8e88-adf1823920f2" returned: 0 in 0.488s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-922e47e3-e60f-4cd2-8e88-adf1823920f2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:41 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Volume volume-302d7c2a-95e1-4bae-a435-26fd183dbc18 (302d7c2a-95e1-4bae-a435-26fd183dbc18): created successfully Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57896c35-0691-46c7-9377-8effda211811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:41 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-922e47e3-e60f-4cd2-8e88-adf1823920f2 Jul 24 15:51:41 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Flow 'volume_create_manager' (9f1e1be7-c489-4b4e-a6c7-3339390711ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:41 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0" returned: 0 in 0.560s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:41 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-be48d1a5-6192-4d49-a309-5b90cef8a625 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Created volume successfully. Jul 24 15:51:41 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0 Jul 24 15:51:41 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:41 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-922e47e3-e60f-4cd2-8e88-adf1823920f2" returned: 0 in 0.287s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Lock "cinder-quobyte-922e47e3-e60f-4cd2-8e88-adf1823920f2" released by "delete_volume" :: held 0.836s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:41 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f003af74-c7d8-4cbe-8e24-f5360d75bab0" returned: 0 in 0.326s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Created reservations ['fc33f4ae-e038-4a6c-8da1-61468eaf75b9'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-f003af74-c7d8-4cbe-8e24-f5360d75bab0" released by "delete_volume" :: held 0.938s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Created reservations ['eb3d690a-2746-432d-983f-74374f1bd425', '916c20bf-77ca-4ab0-b36c-9376175e0b75', '353c2166-8d6c-451e-ac19-514025b8b5ce', '1a8db727-a4ca-4f9d-a6f4-6d49193f17fb'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:41 devstack cinder-volume[88350]: WARNING cinder.quota [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1792317303 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1792317303, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:51:41 devstack cinder-volume[88350]: WARNING cinder.quota [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1792317303 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1792317303, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Created reservations ['8e7d7812-f255-4577-a436-fc63d4328e6f', '353ad2a9-1d81-4c0a-9090-3aad671f8bb2', 'b6bebe97-5840-4ae8-9782-f277dee028c7', '8aa95c5c-2a6c-498f-a76b-021dfa4e5cde'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:41 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:51:41 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:42 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:51:42 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:42 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.268s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:42 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:42 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-4fea3aa6-e64f-4dd1-83e3-7f4c5f8cb462 tempest-GroupsV314Test-875412980 None] Delete group completed successfully. Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.403s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:42 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Deleted volume successfully. Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-11615b27-3dd8-4880-b023-3057f4b8b84e tempest-VolumesGetTest-1514178004 None] Lock "cinder-f003af74-c7d8-4cbe-8e24-f5360d75bab0-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1fdd75dc-fead-4a02-8603-908e655f7740 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1fdd75dc-fead-4a02-8603-908e655f7740 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1fdd75dc-fead-4a02-8603-908e655f7740 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1fdd75dc-fead-4a02-8603-908e655f7740 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1fdd75dc-fead-4a02-8603-908e655f7740 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1fdd75dc-fead-4a02-8603-908e655f7740 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:42 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:51:42 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:43 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1fdd75dc-fead-4a02-8603-908e655f7740 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.260s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-1fdd75dc-fead-4a02-8603-908e655f7740 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:43 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1fdd75dc-fead-4a02-8603-908e655f7740 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Retype volume completed successfully. Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-50ae385a-ca9d-4511-9614-e25d339b396f-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Lock "cinder-50ae385a-ca9d-4511-9614-e25d339b396f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Acquiring lock "cinder-quobyte-50ae385a-ca9d-4511-9614-e25d339b396f" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-50ae385a-ca9d-4511-9614-e25d339b396f" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[86545650-e5a9-415c-9c9d-773ed3c98c0e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] Acquiring lock "cinder-quobyte-606b9c89-2f68-4776-9100-aafc64e08ae5" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:43 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f Jul 24 15:51:43 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] Lock "cinder-quobyte-606b9c89-2f68-4776-9100-aafc64e08ae5" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5507009c-380b-485a-b30b-ae6f9577632b]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:43 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 Jul 24 15:51:43 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:43 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f" returned: 0 in 0.386s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:43 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f Jul 24 15:51:43 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:43 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5" returned: 0 in 0.406s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:43 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-50ae385a-ca9d-4511-9614-e25d339b396f" returned: 0 in 0.249s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:43 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5 Jul 24 15:51:43 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Lock "cinder-quobyte-50ae385a-ca9d-4511-9614-e25d339b396f" released by "delete_volume" :: held 0.695s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:43 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Created reservations ['7130a9d4-1b63-4815-bae6-657759984540', '46b5fbef-d066-4409-a518-d2cd273437e5', '0236c8b0-f384-44a9-850a-7b1b433c485c', 'ea536478-2fdd-46ef-9d29-acadefbee13c'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Acquiring lock "cinder-302d7c2a-95e1-4bae-a435-26fd183dbc18-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:44 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:51:44 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Lock "cinder-302d7c2a-95e1-4bae-a435-26fd183dbc18-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:44 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-606b9c89-2f68-4776-9100-aafc64e08ae5" returned: 0 in 0.286s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Acquiring lock "cinder-quobyte-302d7c2a-95e1-4bae-a435-26fd183dbc18" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] Lock "cinder-quobyte-606b9c89-2f68-4776-9100-aafc64e08ae5" released by "delete_volume" :: held 0.782s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Lock "cinder-quobyte-302d7c2a-95e1-4bae-a435-26fd183dbc18" acquired by "delete_volume" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[261f0945-ca76-4541-b962-7072bebeaf75]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-302d7c2a-95e1-4bae-a435-26fd183dbc18 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] Created reservations ['5b1c3eda-c79c-462e-a4ba-604e49033463'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] Created reservations ['59d8fab7-bf59-4593-b335-91b415a40562', '578e7564-b593-405b-8ec6-6667e6594de4', '047e3fe7-7333-418d-9f66-e4c703e64601', 'a8b18698-35c3-4e70-8b08-b969e58c4460'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:44 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-302d7c2a-95e1-4bae-a435-26fd183dbc18 Jul 24 15:51:44 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:44 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.350s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:44 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Deleted volume successfully. Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-962c9d39-f2e0-40c0-a274-5e45e8b2cf29 tempest-VolumesGetTest-1514178004 None] Lock "cinder-50ae385a-ca9d-4511-9614-e25d339b396f-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:44 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:51:44 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:44 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-302d7c2a-95e1-4bae-a435-26fd183dbc18" returned: 0 in 0.466s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-302d7c2a-95e1-4bae-a435-26fd183dbc18 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:44 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-302d7c2a-95e1-4bae-a435-26fd183dbc18 Jul 24 15:51:44 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:44 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.332s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:44 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-47a118be-1410-411c-8a78-6b579af871ed tempest-GroupsV314Test-875412980 None] Delete group completed successfully. Jul 24 15:51:44 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-302d7c2a-95e1-4bae-a435-26fd183dbc18" returned: 0 in 0.283s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Lock "cinder-quobyte-302d7c2a-95e1-4bae-a435-26fd183dbc18" released by "delete_volume" :: held 0.807s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:45 devstack cinder-volume[88350]: WARNING cinder.quota [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:51:45 devstack cinder-volume[88350]: WARNING cinder.quota [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:51:45 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Created reservations ['5e2d2320-4cb7-4db2-8bb2-66c55b237b00', '0d9d9c63-1252-4e8e-896e-4b4829c919e6', 'cac8943d-d1f9-4f04-9bf8-ec6b2165b66d', '60a0d907-dba5-4956-a3ca-3f1c4a7a44ba'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:51:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:45 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:45 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:45 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:51:45 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:45 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.258s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:45 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:51:45 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Deleted volume successfully. Jul 24 15:51:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-91b922d7-9565-429a-bbdb-81da682e6a48 tempest-VolumeRetypeWithoutMigrationTest-1466469787 None] Lock "cinder-302d7c2a-95e1-4bae-a435-26fd183dbc18-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Flow 'volume_create_manager' (41886a50-fe62-49e5-a672-4cdd70524a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6c91df-2565-4dec-9ec8-179254ea7ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6c91df-2565-4dec-9ec8-179254ea7ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1607319162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d473ba2-ab2f-4851-a761-40fd549b6e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16914e9ef4b3460ea7717d49ba2995e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:48Z,use_quota=True,user_id='5e84e2ced8094ead85fb71a36c97d431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc82fd62-68da-4b43-be78-bc5b2d9f5235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc82fd62-68da-4b43-be78-bc5b2d9f5235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0d0b4a-4eaf-4640-9a6c-b6dfa680cc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed0d0b4a-4eaf-4640-9a6c-b6dfa680cc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d473ba2-ab2f-4851-a761-40fd549b6e77', 'volume_name': 'volume-4d473ba2-ab2f-4851-a761-40fd549b6e77', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67531875-a536-4e42-aa29-367a1cef9dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67531875-a536-4e42-aa29-367a1cef9dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb2d1fe-f08a-4c20-8a26-982f4de0bc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:48 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Volume 4d473ba2-ab2f-4851-a761-40fd549b6e77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d473ba2-ab2f-4851-a761-40fd549b6e77', 'volume_size': 1} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1607319162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d473ba2-ab2f-4851-a761-40fd549b6e77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16914e9ef4b3460ea7717d49ba2995e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:48Z,use_quota=True,user_id='5e84e2ced8094ead85fb71a36c97d431',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Creating volume 4d473ba2-ab2f-4851-a761-40fd549b6e77 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:48 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:51:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d473ba2-ab2f-4851-a761-40fd549b6e77 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:48 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d473ba2-ab2f-4851-a761-40fd549b6e77 1073741824 Jul 24 15:51:48 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:49 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d473ba2-ab2f-4851-a761-40fd549b6e77 1073741824" returned: 0 in 0.531s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d473ba2-ab2f-4851-a761-40fd549b6e77 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:49 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d473ba2-ab2f-4851-a761-40fd549b6e77 Jul 24 15:51:49 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:49 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d473ba2-ab2f-4851-a761-40fd549b6e77" returned: 0 in 0.337s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb2d1fe-f08a-4c20-8a26-982f4de0bc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d473ba2-ab2f-4851-a761-40fd549b6e77', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbcbaaa-f6bd-45f8-b544-e3900d01283f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:49 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Volume volume-4d473ba2-ab2f-4851-a761-40fd549b6e77 (4d473ba2-ab2f-4851-a761-40fd549b6e77): created successfully Jul 24 15:51:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbcbaaa-f6bd-45f8-b544-e3900d01283f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Flow 'volume_create_manager' (41886a50-fe62-49e5-a672-4cdd70524a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:49 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-94cc8993-888f-4717-9283-86e8e269cf51 tempest-VolumesNegativeTest-1310848220 None] Created volume successfully. Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Flow 'volume_create_manager' (4e2ef7ae-51ae-4ecc-816d-8d21119eee7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb9c1f6-3951-4a26-bad5-d28940f99893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb9c1f6-3951-4a26-bad5-d28940f99893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2001128510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e924ab4b-8d6d-4976-b93b-64f4ee765688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72233537285b4631a980120a9134467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:53Z,use_quota=True,user_id='bb47fa980fe14f0d8f47f9c9b093a07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f79b5c-090e-46ea-a142-8e46e1b00bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f79b5c-090e-46ea-a142-8e46e1b00bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559e3be4-d09c-42a6-9d4d-b492f4d7408c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559e3be4-d09c-42a6-9d4d-b492f4d7408c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e924ab4b-8d6d-4976-b93b-64f4ee765688', 'volume_name': 'volume-e924ab4b-8d6d-4976-b93b-64f4ee765688', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81aec800-c750-4439-a6dd-21ed193b455b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81aec800-c750-4439-a6dd-21ed193b455b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7f3c26-95c3-40c3-98d3-aefb0f2311d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:52 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Volume e924ab4b-8d6d-4976-b93b-64f4ee765688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e924ab4b-8d6d-4976-b93b-64f4ee765688', 'volume_size': 1} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2001128510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e924ab4b-8d6d-4976-b93b-64f4ee765688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72233537285b4631a980120a9134467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:51:53Z,use_quota=True,user_id='bb47fa980fe14f0d8f47f9c9b093a07f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Creating volume e924ab4b-8d6d-4976-b93b-64f4ee765688 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:51:52 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:51:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:52 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 1073741824 Jul 24 15:51:52 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-9793867f-abb2-4640-8d92-077d6288c28a req-641ff1b1-bd25-4a96-a2f4-c258a4e6bb09 tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:53 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 1073741824" returned: 0 in 0.768s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:53 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 Jul 24 15:51:53 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:53 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688" returned: 0 in 0.282s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:51:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-9793867f-abb2-4640-8d92-077d6288c28a req-641ff1b1-bd25-4a96-a2f4-c258a4e6bb09 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.408s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7f3c26-95c3-40c3-98d3-aefb0f2311d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e924ab4b-8d6d-4976-b93b-64f4ee765688', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c44dfac-09c6-4d93-ad49-4fb6a350ecc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:51:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-9793867f-abb2-4640-8d92-077d6288c28a req-641ff1b1-bd25-4a96-a2f4-c258a4e6bb09 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.058s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:53 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Volume volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 (e924ab4b-8d6d-4976-b93b-64f4ee765688): created successfully Jul 24 15:51:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c44dfac-09c6-4d93-ad49-4fb6a350ecc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:51:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Flow 'volume_create_manager' (4e2ef7ae-51ae-4ecc-816d-8d21119eee7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:51:53 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-02da4c0f-a5ec-4bfb-83a7-ebb709f9c1b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Created volume successfully. Jul 24 15:51:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-9793867f-abb2-4640-8d92-077d6288c28a req-641ff1b1-bd25-4a96-a2f4-c258a4e6bb09 tempest-TestInstancesWithCinderVolumes-684474430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c180a85-ddaa-4444-8b3b-c41c9383c401', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:51:54 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-9793867f-abb2-4640-8d92-077d6288c28a req-641ff1b1-bd25-4a96-a2f4-c258a4e6bb09 tempest-TestInstancesWithCinderVolumes-684474430 None] attachment_update completed successfully. Jul 24 15:51:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Creating offline snapshot 0ea2c9c1-f368-489a-b0fe-a6318725d08a of volume e924ab4b-8d6d-4976-b93b-64f4ee765688 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:51:55 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[02735291-e200-4839-8333-fff0ac37e8b5]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:51:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:55 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 Jul 24 15:51:55 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:55 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688" returned: 0 in 0.585s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:55 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a 1G Jul 24 15:51:55 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:56 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a 1G" returned: 0 in 0.640s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:56 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a Jul 24 15:51:56 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:56 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a" returned: 0 in 0.466s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:56 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a is being set with open permissions: ugo+rw Jul 24 15:51:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:56 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a Jul 24 15:51:56 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:57 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a" returned: 0 in 0.476s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-5fb83c0f-e4d9-4a8b-84ac-bde678d619f4 req-8da27ba6-d1db-4afb-ab6f-950f3b86968d tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:51:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:57 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.info Jul 24 15:51:57 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:57 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.info" returned: 0 in 0.275s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:57 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.info is being set with open permissions: ugo+rw Jul 24 15:51:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:51:57 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.info Jul 24 15:51:57 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:51:58 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Jul 24 15:51:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.info" returned: 0 in 0.522s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:51:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.137s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-5fb83c0f-e4d9-4a8b-84ac-bde678d619f4 req-8da27ba6-d1db-4afb-ab6f-950f3b86968d tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.860s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:51:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-5fb83c0f-e4d9-4a8b-84ac-bde678d619f4 req-8da27ba6-d1db-4afb-ab6f-950f3b86968d tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.059s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:51:58 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-754de398-68c5-4d49-ad4f-0c048f6fd2c8 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Create snapshot completed successfully Jul 24 15:51:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-5fb83c0f-e4d9-4a8b-84ac-bde678d619f4 req-8da27ba6-d1db-4afb-ab6f-950f3b86968d tempest-TestInstancesWithCinderVolumes-684474430 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-efce9afd-75dd-468b-b86d-5c700ea05f36', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6eeed38-8ec1-46da-8cc1-6c487341e95a', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:51:58 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-5fb83c0f-e4d9-4a8b-84ac-bde678d619f4 req-8da27ba6-d1db-4afb-ab6f-950f3b86968d tempest-TestInstancesWithCinderVolumes-684474430 None] attachment_update completed successfully. Jul 24 15:52:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Acquiring lock "cinder-0ea2c9c1-f368-489a-b0fe-a6318725d08a-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "cinder-0ea2c9c1-f368-489a-b0fe-a6318725d08a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Acquiring lock "cinder-quobyte-e924ab4b-8d6d-4976-b93b-64f4ee765688" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "cinder-quobyte-e924ab4b-8d6d-4976-b93b-64f4ee765688" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Acquiring lock "cinder-quobyte-0ea2c9c1-f368-489a-b0fe-a6318725d08a" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "cinder-quobyte-0ea2c9c1-f368-489a-b0fe-a6318725d08a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Deleting offline snapshot 0ea2c9c1-f368-489a-b0fe-a6318725d08a of volume e924ab4b-8d6d-4976-b93b-64f4ee765688 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:52:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] snapshot_file for this snap is: volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:52:00 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c25c0c8-e26d-4d32-aa42-932187b10b7f]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:00 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a Jul 24 15:52:00 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:00 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a" returned: 0 in 0.467s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e924ab4b-8d6d-4976-b93b-64f4ee765688(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:52:00 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d980f31-b74e-48c7-9352-340da7512766]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:00 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 Jul 24 15:52:00 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:01 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688" returned: 0 in 0.494s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:01 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a Jul 24 15:52:01 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:01 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a" returned: 0 in 0.703s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:01 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a Jul 24 15:52:01 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:02 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688.0ea2c9c1-f368-489a-b0fe-a6318725d08a" returned: 0 in 0.443s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "cinder-quobyte-0ea2c9c1-f368-489a-b0fe-a6318725d08a" released by "_delete_snapshot" :: held 2.279s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "cinder-quobyte-e924ab4b-8d6d-4976-b93b-64f4ee765688" released by "delete_snapshot" :: held 2.325s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:02 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Created reservations ['c6612ad9-bf2d-47e6-b620-89260346e198', 'be394a66-cdfa-4f44-9132-31e51a6bbce3', '32149d6c-c0b0-4b95-bcfb-3403c2fe1afe', 'e0ca5a3f-3713-49e1-8fc5-e8cb88352cf5'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:02 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Delete snapshot completed successfully. Jul 24 15:52:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29c79595-6202-45d4-95d0-0eae6a223943 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "cinder-0ea2c9c1-f368-489a-b0fe-a6318725d08a-delete_snapshot" released by "delete_snapshot" :: held 2.595s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Acquiring lock "cinder-e924ab4b-8d6d-4976-b93b-64f4ee765688-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "cinder-e924ab4b-8d6d-4976-b93b-64f4ee765688-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Acquiring lock "cinder-quobyte-e924ab4b-8d6d-4976-b93b-64f4ee765688" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "cinder-quobyte-e924ab4b-8d6d-4976-b93b-64f4ee765688" acquired by "delete_volume" :: waited 0.037s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:03 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c3813d-82ff-4280-9020-ad45d415f41e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:04 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 Jul 24 15:52:04 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:04 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688" returned: 0 in 0.587s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:04 devstack sudo[100154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688 Jul 24 15:52:04 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:04 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e924ab4b-8d6d-4976-b93b-64f4ee765688" returned: 0 in 0.540s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "cinder-quobyte-e924ab4b-8d6d-4976-b93b-64f4ee765688" released by "delete_volume" :: held 1.230s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:04 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=141,cinder:INSERT=44,cinder:UPDATE=152,cinder:DELETE=10 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:52:05 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Created reservations ['61b45d45-56fc-4e55-9036-284aba78a838', 'ebd3a9be-bfb4-49cb-b07f-af628d7c89ad', 'b464f8a5-89a9-4972-85b9-d8832a93bb37', '6bc35385-8b5b-4c2a-819b-5829e44d103c'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:05 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:52:05 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:05 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.394s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:05 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:05 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Deleted volume successfully. Jul 24 15:52:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6c535680-94f5-428f-aa07-9df2ba93e377 tempest-VolumeSnapshotQuotasNegativeTestJSON-478377159 None] Lock "cinder-e924ab4b-8d6d-4976-b93b-64f4ee765688-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:06 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-08b50ccb-0165-4deb-b5a3-e04caabbe735 req-1a70d517-240a-4e60-9b96-45c49a40cf18 tempest-TestInstancesWithCinderVolumes-684474430 None] Terminate volume connection completed successfully. Jul 24 15:52:06 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-08b50ccb-0165-4deb-b5a3-e04caabbe735 req-1a70d517-240a-4e60-9b96-45c49a40cf18 tempest-TestInstancesWithCinderVolumes-684474430 None] Deleting attachment 0c180a85-ddaa-4444-8b3b-c41c9383c401. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:52:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "cinder-34edef0e-f882-4dcc-8dcc-88de11bedcf3-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "cinder-34edef0e-f882-4dcc-8dcc-88de11bedcf3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "cinder-quobyte-34edef0e-f882-4dcc-8dcc-88de11bedcf3" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "cinder-quobyte-34edef0e-f882-4dcc-8dcc-88de11bedcf3" acquired by "delete_volume" :: waited 0.027s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:07 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb69379e-2819-4985-8e10-0ce41f8ec250]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:07 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3 Jul 24 15:52:07 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:07 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3" returned: 0 in 0.501s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:07 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3 Jul 24 15:52:07 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:08 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34edef0e-f882-4dcc-8dcc-88de11bedcf3" returned: 0 in 0.473s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "cinder-quobyte-34edef0e-f882-4dcc-8dcc-88de11bedcf3" released by "delete_volume" :: held 1.059s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:08 devstack cinder-volume[88350]: WARNING cinder.quota [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2008234104-512705263 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2008234104-512705263, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:52:08 devstack cinder-volume[88350]: WARNING cinder.quota [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2008234104-512705263 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2008234104-512705263, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:52:08 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Created reservations ['17a2ee8b-9688-48a7-81ab-e23cec6661ee', '74c9c0bd-cf2f-4875-be78-3740a4e15036', '999305ad-d8a8-4b30-9481-8bfa96c7c668', '068954ac-07f7-41c6-bc04-76381f89a53d'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:08 devstack sudo[100213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:52:08 devstack sudo[100213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:08 devstack sudo[100213]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.499s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:08 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:08 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Deleted volume successfully. Jul 24 15:52:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0329dcef-a8a0-4cf2-a73f-4b82fabdc721 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "cinder-34edef0e-f882-4dcc-8dcc-88de11bedcf3-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:12 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-bb586152-4013-4cba-bbb3-3760e577e308 req-2f7b6010-de78-44b8-a845-d509b497cda4 tempest-TestInstancesWithCinderVolumes-684474430 None] Terminate volume connection completed successfully. Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-bb586152-4013-4cba-bbb3-3760e577e308 req-2f7b6010-de78-44b8-a845-d509b497cda4 tempest-TestInstancesWithCinderVolumes-684474430 None] Deleting attachment e6eeed38-8ec1-46da-8cc1-6c487341e95a. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Flow 'volume_create_manager' (6f756eca-8fab-49ac-9e83-d013c80a208f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebab64d-c1bb-4a64-a30f-2c46fd1e4524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebab64d-c1bb-4a64-a30f-2c46fd1e4524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-985516282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c33b03-943e-4d8f-a14b-0b42867d81e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a40e71dde0d4daeaf7fd81aa563da9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:12Z,use_quota=True,user_id='770a95da193d46a0875e6a9c43c71226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17450636-3f2f-42f7-873b-6d01e0ab6a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17450636-3f2f-42f7-873b-6d01e0ab6a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5effc3-cf6b-4eb6-833e-b01fc228f7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5effc3-cf6b-4eb6-833e-b01fc228f7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c33b03-943e-4d8f-a14b-0b42867d81e5', 'volume_name': 'volume-76c33b03-943e-4d8f-a14b-0b42867d81e5', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc8f65b-a628-499e-9719-3dd74da09b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccc8f65b-a628-499e-9719-3dd74da09b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b73ef2-d158-476a-b7da-edbb204365a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:12 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Volume 76c33b03-943e-4d8f-a14b-0b42867d81e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c33b03-943e-4d8f-a14b-0b42867d81e5', 'volume_size': 1} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-985516282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c33b03-943e-4d8f-a14b-0b42867d81e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a40e71dde0d4daeaf7fd81aa563da9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:12Z,use_quota=True,user_id='770a95da193d46a0875e6a9c43c71226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Creating volume 76c33b03-943e-4d8f-a14b-0b42867d81e5 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:52:12 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:52:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-76c33b03-943e-4d8f-a14b-0b42867d81e5 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:12 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-76c33b03-943e-4d8f-a14b-0b42867d81e5 1073741824 Jul 24 15:52:12 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:13 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-76c33b03-943e-4d8f-a14b-0b42867d81e5 1073741824" returned: 0 in 0.563s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-76c33b03-943e-4d8f-a14b-0b42867d81e5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:13 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-76c33b03-943e-4d8f-a14b-0b42867d81e5 Jul 24 15:52:13 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:13 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-76c33b03-943e-4d8f-a14b-0b42867d81e5" returned: 0 in 0.330s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:52:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7b73ef2-d158-476a-b7da-edbb204365a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c33b03-943e-4d8f-a14b-0b42867d81e5', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72623aa4-d221-400f-a873-b7639a5fb606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:13 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Volume volume-76c33b03-943e-4d8f-a14b-0b42867d81e5 (76c33b03-943e-4d8f-a14b-0b42867d81e5): created successfully Jul 24 15:52:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72623aa4-d221-400f-a873-b7639a5fb606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Flow 'volume_create_manager' (6f756eca-8fab-49ac-9e83-d013c80a208f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:13 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c86090e8-fc40-4082-8128-5413cbd73320 tempest-VolumeQuotasAdminTestJSON-289416414 None] Created volume successfully. Jul 24 15:52:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "cinder-efce9afd-75dd-468b-b86d-5c700ea05f36-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "cinder-efce9afd-75dd-468b-b86d-5c700ea05f36-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "cinder-quobyte-efce9afd-75dd-468b-b86d-5c700ea05f36" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "cinder-quobyte-efce9afd-75dd-468b-b86d-5c700ea05f36" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:13 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fc16d8-5ce1-46d3-81d4-fbc4d45f37dd]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-efce9afd-75dd-468b-b86d-5c700ea05f36 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:14 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-efce9afd-75dd-468b-b86d-5c700ea05f36 Jul 24 15:52:14 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:14 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-efce9afd-75dd-468b-b86d-5c700ea05f36" returned: 0 in 0.469s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-efce9afd-75dd-468b-b86d-5c700ea05f36 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:14 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-efce9afd-75dd-468b-b86d-5c700ea05f36 Jul 24 15:52:14 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:14 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Acquiring lock "cinder-76c33b03-943e-4d8f-a14b-0b42867d81e5-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-efce9afd-75dd-468b-b86d-5c700ea05f36" returned: 0 in 0.401s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "cinder-quobyte-efce9afd-75dd-468b-b86d-5c700ea05f36" released by "delete_volume" :: held 0.946s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Lock "cinder-76c33b03-943e-4d8f-a14b-0b42867d81e5-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:14 devstack cinder-volume[88350]: WARNING cinder.quota [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-314115245-1390900425 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-314115245-1390900425, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:52:14 devstack cinder-volume[88350]: WARNING cinder.quota [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-314115245-1390900425 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-314115245-1390900425, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:52:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Acquiring lock "cinder-quobyte-76c33b03-943e-4d8f-a14b-0b42867d81e5" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Lock "cinder-quobyte-76c33b03-943e-4d8f-a14b-0b42867d81e5" acquired by "delete_volume" :: waited 0.034s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:15 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Created reservations ['e1f51045-8e46-458d-bb07-71b6c7d81498', '23755a0c-b23b-44b5-9d87-8126e6b70849', 'dd79baa1-1623-48ee-a9e4-bc31d8e5d3c0', 'b23e295f-33e4-4c4f-9f12-d6185012b513'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:15 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b110ee-f591-4c07-bb31-35d0de3f001e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-76c33b03-943e-4d8f-a14b-0b42867d81e5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:15 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-76c33b03-943e-4d8f-a14b-0b42867d81e5 Jul 24 15:52:15 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:52:15 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:15 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:15 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.463s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:15 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:15 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Deleted volume successfully. Jul 24 15:52:15 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-76c33b03-943e-4d8f-a14b-0b42867d81e5" returned: 0 in 0.632s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-76c33b03-943e-4d8f-a14b-0b42867d81e5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:15 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f8903f83-8477-47eb-9f7a-574b75fd02c2 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "cinder-efce9afd-75dd-468b-b86d-5c700ea05f36-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:15 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-76c33b03-943e-4d8f-a14b-0b42867d81e5 Jul 24 15:52:15 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:16 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-76c33b03-943e-4d8f-a14b-0b42867d81e5" returned: 0 in 0.390s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Lock "cinder-quobyte-76c33b03-943e-4d8f-a14b-0b42867d81e5" released by "delete_volume" :: held 1.108s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Created reservations ['2e759c1b-bf84-427b-a854-3469f81f051a', '7017fb6b-e5ff-4f34-8641-a94403ab6e14', 'e2017893-158d-44d5-b7ae-f8851fd38371', 'db5d02ca-3e4d-470b-9f8f-0a440a7bc558'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:16 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:52:16 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:16 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.347s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:16 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Deleted volume successfully. Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2520352a-aa2a-4cac-be5d-cf5b61dc5af3 tempest-VolumeQuotasAdminTestJSON-289416414 None] Lock "cinder-76c33b03-943e-4d8f-a14b-0b42867d81e5-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Acquiring lock "cinder-4d473ba2-ab2f-4851-a761-40fd549b6e77-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Lock "cinder-4d473ba2-ab2f-4851-a761-40fd549b6e77-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Acquiring lock "cinder-quobyte-4d473ba2-ab2f-4851-a761-40fd549b6e77" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Lock "cinder-quobyte-4d473ba2-ab2f-4851-a761-40fd549b6e77" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6676819a-7195-417b-83aa-cabd199c6369]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d473ba2-ab2f-4851-a761-40fd549b6e77 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:16 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d473ba2-ab2f-4851-a761-40fd549b6e77 Jul 24 15:52:16 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:17 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d473ba2-ab2f-4851-a761-40fd549b6e77" returned: 0 in 0.569s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d473ba2-ab2f-4851-a761-40fd549b6e77 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:17 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d473ba2-ab2f-4851-a761-40fd549b6e77 Jul 24 15:52:17 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:17 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d473ba2-ab2f-4851-a761-40fd549b6e77" returned: 0 in 0.454s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Lock "cinder-quobyte-4d473ba2-ab2f-4851-a761-40fd549b6e77" released by "delete_volume" :: held 1.104s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Created reservations ['08144790-8e1f-409e-8f10-b7c46615fe9a', '28b5964b-1152-4d81-8644-65002108de4f', 'f1519876-8913-4da3-b163-33c6aa1c3690', '32782f49-3439-4836-a4fa-249fdd984628'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Flow 'volume_create_manager' (f00b2ce8-1ab5-4227-9082-0f3b3a676f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20e144c-a18f-4c8c-a4cc-05ded1cac908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a20e144c-a18f-4c8c-a4cc-05ded1cac908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1816742071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6734edd-f97f-46e8-ab5e-9ca205a50848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a40e71dde0d4daeaf7fd81aa563da9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:18Z,use_quota=True,user_id='770a95da193d46a0875e6a9c43c71226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7866f66-fd26-44c7-b6d4-2610be9b20c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7866f66-fd26-44c7-b6d4-2610be9b20c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b910c5-0bb0-490f-807e-d8b9e41c60a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b910c5-0bb0-490f-807e-d8b9e41c60a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6734edd-f97f-46e8-ab5e-9ca205a50848', 'volume_name': 'volume-a6734edd-f97f-46e8-ab5e-9ca205a50848', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12832ed8-afac-4bd8-89e0-1d070e8c5dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12832ed8-afac-4bd8-89e0-1d070e8c5dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddb9789-245c-4eab-8464-6fdd121c0643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:18 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Volume a6734edd-f97f-46e8-ab5e-9ca205a50848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6734edd-f97f-46e8-ab5e-9ca205a50848', 'volume_size': 1} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1816742071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6734edd-f97f-46e8-ab5e-9ca205a50848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a40e71dde0d4daeaf7fd81aa563da9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:18Z,use_quota=True,user_id='770a95da193d46a0875e6a9c43c71226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Creating volume a6734edd-f97f-46e8-ab5e-9ca205a50848 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:52:18 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a6734edd-f97f-46e8-ab5e-9ca205a50848 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:18 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a6734edd-f97f-46e8-ab5e-9ca205a50848 1073741824 Jul 24 15:52:18 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:18 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:52:18 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:18 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.529s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:18 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Deleted volume successfully. Jul 24 15:52:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cf8f37e3-3e26-49c1-9a5c-ad28bc063824 tempest-VolumesNegativeTest-1310848220 None] Lock "cinder-4d473ba2-ab2f-4851-a761-40fd549b6e77-delete_volume" released by "delete_volume" :: held 2.122s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:19 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a6734edd-f97f-46e8-ab5e-9ca205a50848 1073741824" returned: 0 in 0.839s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a6734edd-f97f-46e8-ab5e-9ca205a50848 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:19 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a6734edd-f97f-46e8-ab5e-9ca205a50848 Jul 24 15:52:19 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:19 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a6734edd-f97f-46e8-ab5e-9ca205a50848" returned: 0 in 0.333s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:52:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddb9789-245c-4eab-8464-6fdd121c0643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6734edd-f97f-46e8-ab5e-9ca205a50848', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b171e0c6-13cc-488b-bbc3-aabf1b8f1928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:19 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Volume volume-a6734edd-f97f-46e8-ab5e-9ca205a50848 (a6734edd-f97f-46e8-ab5e-9ca205a50848): created successfully Jul 24 15:52:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b171e0c6-13cc-488b-bbc3-aabf1b8f1928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Flow 'volume_create_manager' (f00b2ce8-1ab5-4227-9082-0f3b3a676f2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:19 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-941ecc98-c718-4399-a11b-6a2688535ea5 tempest-VolumeQuotasAdminTestJSON-289416414 None] Created volume successfully. Jul 24 15:52:20 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-6f416d7a-d82a-4fc6-b0f1-bf6fd8418688 req-b7c4bf3e-0926-440b-ae26-64d85d2559fe tempest-TestInstancesWithCinderVolumes-684474430 None] Terminate volume connection completed successfully. Jul 24 15:52:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-6f416d7a-d82a-4fc6-b0f1-bf6fd8418688 req-b7c4bf3e-0926-440b-ae26-64d85d2559fe tempest-TestInstancesWithCinderVolumes-684474430 None] Deleting attachment 12e6aac5-d47c-4d91-9331-7eab7b73fc76. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:52:21 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-41fd1cfa-797c-4640-9816-54120599ea4d tempest-VolumeQuotasAdminTestJSON-1896531577 None] Transfer volume completed successfully. Jul 24 15:52:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "cinder-94e651c6-a7e2-438e-8c75-ed9cd7203c74-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "cinder-94e651c6-a7e2-438e-8c75-ed9cd7203c74-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "cinder-quobyte-94e651c6-a7e2-438e-8c75-ed9cd7203c74" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "cinder-quobyte-94e651c6-a7e2-438e-8c75-ed9cd7203c74" acquired by "delete_volume" :: waited 0.033s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:22 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa06e9e6-5240-4357-98e5-6c219eb21ca5]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Acquiring lock "cinder-a6734edd-f97f-46e8-ab5e-9ca205a50848-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Lock "cinder-a6734edd-f97f-46e8-ab5e-9ca205a50848-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:22 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 Jul 24 15:52:22 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Acquiring lock "cinder-quobyte-a6734edd-f97f-46e8-ab5e-9ca205a50848" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:52:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Lock "cinder-quobyte-a6734edd-f97f-46e8-ab5e-9ca205a50848" acquired by "delete_volume" :: waited 0.034s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:52:22 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a454f81-2044-4b15-9420-c03f857de1a0]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a6734edd-f97f-46e8-ab5e-9ca205a50848 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:22 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a6734edd-f97f-46e8-ab5e-9ca205a50848 Jul 24 15:52:22 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:22 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74" returned: 0 in 0.530s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:22 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74 Jul 24 15:52:22 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:22 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a6734edd-f97f-46e8-ab5e-9ca205a50848" returned: 0 in 0.462s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a6734edd-f97f-46e8-ab5e-9ca205a50848 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:22 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a6734edd-f97f-46e8-ab5e-9ca205a50848 Jul 24 15:52:22 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:22 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-94e651c6-a7e2-438e-8c75-ed9cd7203c74" returned: 0 in 0.311s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "cinder-quobyte-94e651c6-a7e2-438e-8c75-ed9cd7203c74" released by "delete_volume" :: held 0.929s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:22 devstack cinder-volume[88350]: WARNING cinder.quota [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1957253299-1658113092 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1957253299-1658113092, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:52:22 devstack cinder-volume[88350]: WARNING cinder.quota [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1957253299-1658113092 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1957253299-1658113092, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Created reservations ['cdc6b53d-259b-47ae-bb01-9569797422e0', '4b81c860-b1d8-41ab-b6e5-3a8c8d69a686', 'd8c21818-ffb8-4aa2-b6ad-6391aeceb9bc', '97265fc8-c978-4f6d-ad76-b9dc38aae249'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:23 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a6734edd-f97f-46e8-ab5e-9ca205a50848" returned: 0 in 0.353s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Lock "cinder-quobyte-a6734edd-f97f-46e8-ab5e-9ca205a50848" released by "delete_volume" :: held 0.915s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:23 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:52:23 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Created reservations ['c65212ef-3d2a-4430-a14a-96c96215fdbc', 'a06a12e1-b2c9-469a-841b-a5f6f8132304', 'f74c8ea0-01fd-4bdd-9185-9be4b5d875a2', 'bc34caf1-d94a-4bef-96ca-d4390ad597a8'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:23 devstack sudo[100357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:52:23 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:23 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.465s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:23 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Deleted volume successfully. Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4c4e0e1f-7768-4a04-8363-4ee5ca5fb4f7 tempest-TestInstancesWithCinderVolumes-684474430 None] Lock "cinder-94e651c6-a7e2-438e-8c75-ed9cd7203c74-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:23 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.371s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:23 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Deleted volume successfully. Jul 24 15:52:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-409fee97-d2a6-40bb-aad6-0d2d343f548c tempest-VolumeQuotasAdminTestJSON-234184041 None] Lock "cinder-a6734edd-f97f-46e8-ab5e-9ca205a50848-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:52:33 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=73,cinder:SELECT=40,cinder:DELETE=5,cinder:INSERT=12 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:52:33 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=122,cinder:SELECT=118,cinder:INSERT=32,cinder:DELETE=8 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:52:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:52:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:40 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:52:40 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:40 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.350s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:52:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:52:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:52:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Flow 'volume_create_manager' (1953b6f0-0bb0-4d23-813e-aa0ff8a757a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0be60ae-bee9-4432-8702-eaefa4e0c54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0be60ae-bee9-4432-8702-eaefa4e0c54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1087542165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca4c099-4693-4634-8843-573dc0f473f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073acff319994c69a8a4467e2533d450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:51Z,use_quota=True,user_id='6ab3570cfe29428a97c5a7f791699606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018f6009-ff0a-47bd-867a-7e8910d29840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018f6009-ff0a-47bd-867a-7e8910d29840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b6ea03-a6d3-4cb1-bfb9-24570ebce7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b6ea03-a6d3-4cb1-bfb9-24570ebce7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eca4c099-4693-4634-8843-573dc0f473f4', 'volume_name': 'volume-eca4c099-4693-4634-8843-573dc0f473f4', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e7e524-9cc5-40d0-9d17-2a28a2054935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e7e524-9cc5-40d0-9d17-2a28a2054935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547208c6-a388-4752-84b8-e69820da4933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:51 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume eca4c099-4693-4634-8843-573dc0f473f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eca4c099-4693-4634-8843-573dc0f473f4', 'volume_size': 1} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1087542165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca4c099-4693-4634-8843-573dc0f473f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073acff319994c69a8a4467e2533d450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:51Z,use_quota=True,user_id='6ab3570cfe29428a97c5a7f791699606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Creating volume eca4c099-4693-4634-8843-573dc0f473f4 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:52:51 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:51 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4 1073741824 Jul 24 15:52:51 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:51 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4 1073741824" returned: 0 in 0.615s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:51 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4 Jul 24 15:52:51 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:52 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4" returned: 0 in 0.306s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:52:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (547208c6-a388-4752-84b8-e69820da4933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eca4c099-4693-4634-8843-573dc0f473f4', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129b2223-96a6-447c-a1ea-f9dfe0399f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:52 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume volume-eca4c099-4693-4634-8843-573dc0f473f4 (eca4c099-4693-4634-8843-573dc0f473f4): created successfully Jul 24 15:52:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129b2223-96a6-447c-a1ea-f9dfe0399f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Flow 'volume_create_manager' (1953b6f0-0bb0-4d23-813e-aa0ff8a757a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:52 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-0e6ab442-303b-4840-93a8-938d077134c0 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Created volume successfully. Jul 24 15:52:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Creating offline snapshot becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 of volume eca4c099-4693-4634-8843-573dc0f473f4 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:52:53 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[876d9a2a-2e98-42ef-8f6e-36b551064312]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:52:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:53 devstack sudo[100402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4 Jul 24 15:52:53 devstack sudo[100402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:53 devstack sudo[100402]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4" returned: 0 in 0.440s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:53 devstack sudo[100407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 1G Jul 24 15:52:53 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:54 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 1G" returned: 0 in 0.653s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eca4c099-4693-4634-8843-573dc0f473f4 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:54 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eca4c099-4693-4634-8843-573dc0f473f4 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 Jul 24 15:52:54 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:55 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eca4c099-4693-4634-8843-573dc0f473f4 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9" returned: 0 in 0.555s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:55 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 is being set with open permissions: ugo+rw Jul 24 15:52:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:55 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 Jul 24 15:52:55 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:55 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9" returned: 0 in 0.399s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:55 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.info Jul 24 15:52:55 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:56 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.info" returned: 0 in 0.529s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:56 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.info is being set with open permissions: ugo+rw Jul 24 15:52:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:56 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.info Jul 24 15:52:56 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:52:56 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Jul 24 15:52:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.info" returned: 0 in 0.526s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:52:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.269s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:56 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-661ce400-5b0a-4ba8-9488-aa0b4800ad87 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Create snapshot completed successfully Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Flow 'volume_create_manager' (261f5538-b899-428c-9709-d0a6562d897a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698220a1-4b9d-4ce2-9d31-b6692ba89a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698220a1-4b9d-4ce2-9d31-b6692ba89a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-179447121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c0774b0-9fa3-4b5f-8edf-b62658a89667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073acff319994c69a8a4467e2533d450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:59Z,use_quota=True,user_id='6ab3570cfe29428a97c5a7f791699606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517a15db-f0a7-4d4c-8ffd-7983811d854b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517a15db-f0a7-4d4c-8ffd-7983811d854b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f2f96f-2f92-4e6a-b110-acd382618e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f2f96f-2f92-4e6a-b110-acd382618e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c0774b0-9fa3-4b5f-8edf-b62658a89667', 'volume_name': 'volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8482881-5dfa-413b-b6ce-8787bcd399f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8482881-5dfa-413b-b6ce-8787bcd399f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0093471-3aaf-4e04-9db6-ea08ad4637b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:52:59 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume 4c0774b0-9fa3-4b5f-8edf-b62658a89667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667', 'volume_size': 1} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-179447121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c0774b0-9fa3-4b5f-8edf-b62658a89667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073acff319994c69a8a4467e2533d450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:52:59Z,use_quota=True,user_id='6ab3570cfe29428a97c5a7f791699606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Creating volume 4c0774b0-9fa3-4b5f-8edf-b62658a89667 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:52:59 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:52:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:52:59 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667 1073741824 Jul 24 15:52:59 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:00 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Flow 'volume_create_manager' (977bb7cd-8831-4a36-a5ab-4be6d2fbdd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abacfe6-c49f-4139-82b9-b2b79fb02954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abacfe6-c49f-4139-82b9-b2b79fb02954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879639102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b90a38a-a300-4eee-bf8a-5d96769a479a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073acff319994c69a8a4467e2533d450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:00Z,use_quota=True,user_id='6ab3570cfe29428a97c5a7f791699606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2aeb78-593e-4b67-b4a7-1a473ab76d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b2aeb78-593e-4b67-b4a7-1a473ab76d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a59629-eb29-4a55-9503-949167477be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a59629-eb29-4a55-9503-949167477be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b90a38a-a300-4eee-bf8a-5d96769a479a', 'volume_name': 'volume-4b90a38a-a300-4eee-bf8a-5d96769a479a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42baf2eb-3d39-473a-8e2f-87bc4bc4702a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42baf2eb-3d39-473a-8e2f-87bc4bc4702a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:00 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c1b8fc-41d6-409d-ba30-c57d8ebdb709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:00 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume 4b90a38a-a300-4eee-bf8a-5d96769a479a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b90a38a-a300-4eee-bf8a-5d96769a479a', 'volume_size': 1} Jul 24 15:53:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667 1073741824" returned: 0 in 1.116s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:00 devstack sudo[100551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667 Jul 24 15:53:00 devstack sudo[100551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:00 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Flow 'volume_create_manager' (daa6f233-d9c2-4ce6-9a30-dc24478f0cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f04bdb-4707-48e6-a269-e2baa4001c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:01 devstack sudo[100551]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667" returned: 0 in 0.788s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.985s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.857s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879639102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b90a38a-a300-4eee-bf8a-5d96769a479a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073acff319994c69a8a4467e2533d450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:00Z,use_quota=True,user_id='6ab3570cfe29428a97c5a7f791699606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Creating volume 4b90a38a-a300-4eee-bf8a-5d96769a479a {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:01 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4b90a38a-a300-4eee-bf8a-5d96769a479a 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f04bdb-4707-48e6-a269-e2baa4001c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1461476614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f67e208-30f7-42df-a4b3-37515c806de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073acff319994c69a8a4467e2533d450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:01Z,use_quota=True,user_id='6ab3570cfe29428a97c5a7f791699606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:01 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4b90a38a-a300-4eee-bf8a-5d96769a479a 1073741824 Jul 24 15:53:01 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9f4d47-3099-49fd-a18b-62049213bb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d9f4d47-3099-49fd-a18b-62049213bb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a05ad6-1281-480b-adee-284814c45bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a05ad6-1281-480b-adee-284814c45bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f67e208-30f7-42df-a4b3-37515c806de4', 'volume_name': 'volume-7f67e208-30f7-42df-a4b3-37515c806de4', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b58d857-fc3a-42e9-905a-d5548f75495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b58d857-fc3a-42e9-905a-d5548f75495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109ca224-bc26-4b54-9e40-08cdf091f252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:01 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume 7f67e208-30f7-42df-a4b3-37515c806de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f67e208-30f7-42df-a4b3-37515c806de4', 'volume_size': 1} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0093471-3aaf-4e04-9db6-ea08ad4637b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef693880-6b7c-40d1-9eb9-a29f83496ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:01 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667 (4c0774b0-9fa3-4b5f-8edf-b62658a89667): created successfully Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef693880-6b7c-40d1-9eb9-a29f83496ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Flow 'volume_create_manager' (261f5538-b899-428c-9709-d0a6562d897a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Flow 'volume_create_manager' (209b07b2-00ca-4765-a0da-38653f12b047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8711e4a4-de81-4d0a-88b8-a8ed1f8649e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:01 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-aadd469f-8520-4d41-b8ca-d607bd835033 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Created volume successfully. Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8711e4a4-de81-4d0a-88b8-a8ed1f8649e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1603509918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad3ea90-484d-4395-b457-4a15cd12848e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073acff319994c69a8a4467e2533d450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:02Z,use_quota=True,user_id='6ab3570cfe29428a97c5a7f791699606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7639ed06-0e03-4466-a3e2-4abd7e5dc59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7639ed06-0e03-4466-a3e2-4abd7e5dc59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe7fae0-7d38-4bef-8ec3-d9bb79a61fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe7fae0-7d38-4bef-8ec3-d9bb79a61fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ad3ea90-484d-4395-b457-4a15cd12848e', 'volume_name': 'volume-9ad3ea90-484d-4395-b457-4a15cd12848e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e3f883-6dbb-4e79-a4d1-96e0e60cfd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e3f883-6dbb-4e79-a4d1-96e0e60cfd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771c16b9-f82f-4ec3-b75b-6c610955b9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:02 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume 9ad3ea90-484d-4395-b457-4a15cd12848e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ad3ea90-484d-4395-b457-4a15cd12848e', 'volume_size': 1} Jul 24 15:53:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:02 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4b90a38a-a300-4eee-bf8a-5d96769a479a 1073741824" returned: 0 in 1.240s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4b90a38a-a300-4eee-bf8a-5d96769a479a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:02 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4b90a38a-a300-4eee-bf8a-5d96769a479a Jul 24 15:53:02 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:03 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4b90a38a-a300-4eee-bf8a-5d96769a479a" returned: 0 in 0.431s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.518s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1461476614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f67e208-30f7-42df-a4b3-37515c806de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073acff319994c69a8a4467e2533d450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:01Z,use_quota=True,user_id='6ab3570cfe29428a97c5a7f791699606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Creating volume 7f67e208-30f7-42df-a4b3-37515c806de4 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:03 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f67e208-30f7-42df-a4b3-37515c806de4 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:03 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f67e208-30f7-42df-a4b3-37515c806de4 1073741824 Jul 24 15:53:03 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c1b8fc-41d6-409d-ba30-c57d8ebdb709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b90a38a-a300-4eee-bf8a-5d96769a479a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db3b10d-92f6-4f88-9c4f-31e52a7c1946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:03 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume volume-4b90a38a-a300-4eee-bf8a-5d96769a479a (4b90a38a-a300-4eee-bf8a-5d96769a479a): created successfully Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2db3b10d-92f6-4f88-9c4f-31e52a7c1946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Flow 'volume_create_manager' (977bb7cd-8831-4a36-a5ab-4be6d2fbdd6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Flow 'volume_create_manager' (0b2be8b3-44a0-4685-8dd8-819d79b52eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d3a06c-b6bc-416e-8c24-5c7ef7fb23ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Flow 'volume_create_manager' (1d05e66b-be27-4027-8418-33dd43299dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29b489f-5c5b-44ae-adb2-f4daea3005d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f29b489f-5c5b-44ae-adb2-f4daea3005d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-306514061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cac99ef11c44eeab3f0cc0d3295e254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:03Z,use_quota=True,user_id='cc1f786d80014de79b97b0f57d1e9d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adaf9e2c-4634-4166-8103-c2f1e2067a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adaf9e2c-4634-4166-8103-c2f1e2067a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11eb9b45-9447-4d36-acd2-4509c049a4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11eb9b45-9447-4d36-acd2-4509c049a4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a', 'volume_name': 'volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b72d96-64a5-42ef-b11b-7588588d8a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b72d96-64a5-42ef-b11b-7588588d8a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acacbd15-cb03-4aa1-a08c-db59efa5dc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:03 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Volume 8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a', 'volume_size': 1} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:03 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a21bb09e-381d-4364-8f39-48e862cb177a tempest-CreateVolumesFromSnapshotTest-1202224260 None] Created volume successfully. Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0d3a06c-b6bc-416e-8c24-5c7ef7fb23ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1079956894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073acff319994c69a8a4467e2533d450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:03Z,use_quota=True,user_id='6ab3570cfe29428a97c5a7f791699606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e16dd9-e809-43cd-8a37-e5d060c04de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99e16dd9-e809-43cd-8a37-e5d060c04de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74491df2-ec23-4f9c-9908-a65ddf8d4bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74491df2-ec23-4f9c-9908-a65ddf8d4bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae', 'volume_name': 'volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80fac9a-e4a9-40c3-b484-abc4ade002a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c80fac9a-e4a9-40c3-b484-abc4ade002a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e193c748-9b13-4f49-8b59-768a167f6caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:03 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume 2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae', 'volume_size': 1} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Flow 'volume_create_manager' (ad87fdef-fecd-4668-b32c-add77700543c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb63e35a-7a45-4534-b669-239b93b0ea19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb63e35a-7a45-4534-b669-239b93b0ea19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2126178191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4699fd-be72-46bb-a518-99e1bcb2de60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b87533f96224770abb1cfa38a954b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:04Z,use_quota=True,user_id='2ab16052431c46f9bc6046a579c10730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5e1ed2-a63f-4469-829a-869d57bf8a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb5e1ed2-a63f-4469-829a-869d57bf8a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c235fa54-7353-42b4-bddd-811a4e80587c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c235fa54-7353-42b4-bddd-811a4e80587c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4699fd-be72-46bb-a518-99e1bcb2de60', 'volume_name': 'volume-1f4699fd-be72-46bb-a518-99e1bcb2de60', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5601d3b4-f600-42fe-a231-99e75856438f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5601d3b4-f600-42fe-a231-99e75856438f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fcd1ca-d151-4106-87ee-c5983cc6ef36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:04 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Volume 1f4699fd-be72-46bb-a518-99e1bcb2de60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4699fd-be72-46bb-a518-99e1bcb2de60', 'volume_size': 1} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:04 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f67e208-30f7-42df-a4b3-37515c806de4 1073741824" returned: 0 in 0.954s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f67e208-30f7-42df-a4b3-37515c806de4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:04 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f67e208-30f7-42df-a4b3-37515c806de4 Jul 24 15:53:04 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:04 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f67e208-30f7-42df-a4b3-37515c806de4" returned: 0 in 0.321s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.368s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1603509918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad3ea90-484d-4395-b457-4a15cd12848e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073acff319994c69a8a4467e2533d450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:02Z,use_quota=True,user_id='6ab3570cfe29428a97c5a7f791699606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Creating volume 9ad3ea90-484d-4395-b457-4a15cd12848e {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:04 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ad3ea90-484d-4395-b457-4a15cd12848e 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (109ca224-bc26-4b54-9e40-08cdf091f252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f67e208-30f7-42df-a4b3-37515c806de4', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35445b6e-158e-47f1-b357-b678f2a3ff28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:04 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ad3ea90-484d-4395-b457-4a15cd12848e 1073741824 Jul 24 15:53:04 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:04 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume volume-7f67e208-30f7-42df-a4b3-37515c806de4 (7f67e208-30f7-42df-a4b3-37515c806de4): created successfully Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35445b6e-158e-47f1-b357-b678f2a3ff28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Flow 'volume_create_manager' (daa6f233-d9c2-4ce6-9a30-dc24478f0cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:04 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-bb5967e1-cb85-42cd-a025-df6006a53468 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Created volume successfully. Jul 24 15:53:05 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ad3ea90-484d-4395-b457-4a15cd12848e 1073741824" returned: 0 in 0.605s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ad3ea90-484d-4395-b457-4a15cd12848e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:05 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ad3ea90-484d-4395-b457-4a15cd12848e Jul 24 15:53:05 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:05 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ad3ea90-484d-4395-b457-4a15cd12848e" returned: 0 in 0.285s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.891s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-306514061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cac99ef11c44eeab3f0cc0d3295e254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:03Z,use_quota=True,user_id='cc1f786d80014de79b97b0f57d1e9d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Creating volume 8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:05 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (771c16b9-f82f-4ec3-b75b-6c610955b9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad3ea90-484d-4395-b457-4a15cd12848e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b9d00f-bc5f-43f3-8ca6-5393d91918d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:05 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a 1073741824 Jul 24 15:53:05 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:05 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume volume-9ad3ea90-484d-4395-b457-4a15cd12848e (9ad3ea90-484d-4395-b457-4a15cd12848e): created successfully Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95b9d00f-bc5f-43f3-8ca6-5393d91918d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Flow 'volume_create_manager' (209b07b2-00ca-4765-a0da-38653f12b047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:05 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-4d93875c-1aa1-44a7-b0ea-93eb95b45ec3 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Created volume successfully. Jul 24 15:53:05 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a 1073741824" returned: 0 in 0.583s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:06 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a Jul 24 15:53:06 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:06 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a" returned: 0 in 0.334s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.795s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1079956894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073acff319994c69a8a4467e2533d450',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:03Z,use_quota=True,user_id='6ab3570cfe29428a97c5a7f791699606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Creating volume 2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:06 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:06 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae 1073741824 Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acacbd15-cb03-4aa1-a08c-db59efa5dc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:06 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358efdb3-f9d3-420f-a683-8d85d11bcf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:06 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Volume volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a (8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a): created successfully Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358efdb3-f9d3-420f-a683-8d85d11bcf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Flow 'volume_create_manager' (1d05e66b-be27-4027-8418-33dd43299dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:06 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-ed7a19de-11de-455b-a0ee-645eb2f7c4a1 tempest-VolumesActionsTest-1968172073 None] Created volume successfully. Jul 24 15:53:06 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae 1073741824" returned: 0 in 0.539s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:07 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae Jul 24 15:53:07 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-41101695-da46-47de-87b5-106c608b3580 tempest-VolumesActionsTest-1968172073 None] Acquiring lock "cinder-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a" by "attach_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-41101695-da46-47de-87b5-106c608b3580 tempest-VolumesActionsTest-1968172073 None] Lock "cinder-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a" acquired by "attach_volume" :: waited 0.038s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:07 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae" returned: 0 in 0.356s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.305s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2126178191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4699fd-be72-46bb-a518-99e1bcb2de60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b87533f96224770abb1cfa38a954b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:04Z,use_quota=True,user_id='2ab16052431c46f9bc6046a579c10730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Creating volume 1f4699fd-be72-46bb-a518-99e1bcb2de60 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:07 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e193c748-9b13-4f49-8b59-768a167f6caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:07 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 1073741824 Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e7720a-ddf7-4d71-a865-59739f89c5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:07 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:07 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Volume volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae (2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae): created successfully Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84e7720a-ddf7-4d71-a865-59739f89c5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Flow 'volume_create_manager' (0b2be8b3-44a0-4685-8dd8-819d79b52eab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:07 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-41101695-da46-47de-87b5-106c608b3580 tempest-VolumesActionsTest-1968172073 None] Attaching volume 8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a to instance 9f608b6e-1054-4fe5-9ac3-80296fdd095c at mountpoint /dev/vdb on host None. Jul 24 15:53:07 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f30ced14-0500-44aa-8acd-8f5a14aad056 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Created volume successfully. Jul 24 15:53:07 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-41101695-da46-47de-87b5-106c608b3580 tempest-VolumesActionsTest-1968172073 None] Attach volume completed successfully. Jul 24 15:53:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-41101695-da46-47de-87b5-106c608b3580 tempest-VolumesActionsTest-1968172073 None] Lock "cinder-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a" released by "attach_volume" :: held 0.218s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:07 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 1073741824" returned: 0 in 0.640s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:08 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 Jul 24 15:53:08 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:08 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1520a67b-eee4-4942-87cd-f6a904a96c87 tempest-VolumesActionsTest-1063434863 None] Terminate volume connection completed successfully. Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1520a67b-eee4-4942-87cd-f6a904a96c87 tempest-VolumesActionsTest-1063434863 None] Acquiring lock "cinder-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a-detach_volume" by "detach_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1520a67b-eee4-4942-87cd-f6a904a96c87 tempest-VolumesActionsTest-1063434863 None] Lock "cinder-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:08 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1520a67b-eee4-4942-87cd-f6a904a96c87 tempest-VolumesActionsTest-1063434863 None] Detaching volume 8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a from instance 9f608b6e-1054-4fe5-9ac3-80296fdd095c. Jul 24 15:53:08 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60" returned: 0 in 0.397s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44fcd1ca-d151-4106-87ee-c5983cc6ef36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4699fd-be72-46bb-a518-99e1bcb2de60', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce23f36-ccfb-418e-9f98-59cf6db35b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:08 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Volume volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 (1f4699fd-be72-46bb-a518-99e1bcb2de60): created successfully Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce23f36-ccfb-418e-9f98-59cf6db35b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Flow 'volume_create_manager' (ad87fdef-fecd-4668-b32c-add77700543c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "cinder-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:08 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1520a67b-eee4-4942-87cd-f6a904a96c87 tempest-VolumesActionsTest-1063434863 None] Detach volume completed successfully. Jul 24 15:53:08 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-9ae253e1-6b1b-4f1f-9625-e72c91d8ff78 tempest-VolumesDeleteCascade-1446356427 None] Created volume successfully. Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1520a67b-eee4-4942-87cd-f6a904a96c87 tempest-VolumesActionsTest-1063434863 None] Lock "cinder-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a-detach_volume" released by "detach_volume" :: held 0.187s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "cinder-quobyte-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7b9297-5d93-406b-a072-d63459ed0371]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cde19458-8187-4733-82cf-c5da8675c26d tempest-VolumesActionsTest-1968172073 None] Acquiring lock "cinder-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a-detach_volume" by "detach_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:08 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae Jul 24 15:53:08 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cde19458-8187-4733-82cf-c5da8675c26d tempest-VolumesActionsTest-1968172073 None] Lock "cinder-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:08 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-cde19458-8187-4733-82cf-c5da8675c26d tempest-VolumesActionsTest-1968172073 None] Volume detach called, but volume not attached. Jul 24 15:53:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cde19458-8187-4733-82cf-c5da8675c26d tempest-VolumesActionsTest-1968172073 None] Lock "cinder-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:09 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae" returned: 0 in 0.565s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Acquiring lock "cinder-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:09 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae Jul 24 15:53:09 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Lock "cinder-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Acquiring lock "cinder-quobyte-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Lock "cinder-quobyte-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a" acquired by "delete_volume" :: waited 0.052s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6932004c-7333-42b2-a751-0d3f99b04b34]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:09 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae" returned: 0 in 0.429s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae" released by "delete_volume" :: held 1.090s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:09 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a Jul 24 15:53:09 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Created reservations ['674d3192-510d-412f-981f-65353a699aaa', '4f824e85-fab9-4522-ab0e-10f26d063dbd', '9abca22e-e694-4d5d-9dac-0151e3aa4467', '7659e1fc-cad4-41c5-9be0-2af2f7e1ee59'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] Creating offline snapshot 5cd2d625-9c91-48df-84df-f0c1ac96a195 of volume 1f4699fd-be72-46bb-a518-99e1bcb2de60 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f6a5ad-29e2-4244-8d12-868c4c3c791e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:10 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:10 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:10 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 Jul 24 15:53:10 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:10 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a" returned: 0 in 0.764s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:10 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a Jul 24 15:53:10 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:10 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.522s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:10 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:10 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Deleted volume successfully. Jul 24 15:53:10 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c8663ae4-1922-407b-a21b-6cc42e984b93 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-2de50f7f-b5c9-4a54-99c2-ffa706d0c8ae-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:10 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:10 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60" returned: 0 in 0.945s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a" returned: 0 in 0.531s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:10 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 1G Jul 24 15:53:10 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Lock "cinder-quobyte-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a" released by "delete_volume" :: held 1.471s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "cinder-9ad3ea90-484d-4395-b457-4a15cd12848e-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-9ad3ea90-484d-4395-b457-4a15cd12848e-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "cinder-quobyte-9ad3ea90-484d-4395-b457-4a15cd12848e" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Created reservations ['f940bdf3-c679-4367-96f4-965403ca802e', 'e4fc3ff1-a971-4bb1-beb9-6fba477e7be3', 'a9595e89-a583-4475-a79c-3bb1771049ba', '081c4a77-03cf-4c5e-9324-778f6d39aed9'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-9ad3ea90-484d-4395-b457-4a15cd12848e" acquired by "delete_volume" :: waited 0.036s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eb27a7-8bcd-40f4-8a64-9cbef0b0c8a5]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ad3ea90-484d-4395-b457-4a15cd12848e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:11 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:11 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:11 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ad3ea90-484d-4395-b457-4a15cd12848e Jul 24 15:53:11 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:11 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 1G" returned: 0 in 0.928s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:11 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 Jul 24 15:53:11 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:12 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.526s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:12 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:12 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Deleted volume successfully. Jul 24 15:53:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-02bc5fa6-8640-46d1-920d-b6b528568947 tempest-VolumesActionsTest-1968172073 None] Lock "cinder-8bc62651-dcf8-4f6c-81aa-6bbef0a8f83a-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:12 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ad3ea90-484d-4395-b457-4a15cd12848e" returned: 0 in 0.935s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ad3ea90-484d-4395-b457-4a15cd12848e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:12 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ad3ea90-484d-4395-b457-4a15cd12848e Jul 24 15:53:12 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:12 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195" returned: 0 in 0.774s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:12 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 is being set with open permissions: ugo+rw Jul 24 15:53:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:12 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 Jul 24 15:53:12 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:12 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ad3ea90-484d-4395-b457-4a15cd12848e" returned: 0 in 0.444s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-9ad3ea90-484d-4395-b457-4a15cd12848e" released by "delete_volume" :: held 1.450s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Created reservations ['5beed289-7c96-45ad-af5e-422e673e5f12', '4221134f-63f6-43f6-bfd2-9bb13e412183', '9e8f49c1-7e20-487d-a0b5-7661b3a4d4b9', '0f7f6f99-5197-4963-bcad-e9dc274f356e'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:13 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195" returned: 0 in 0.519s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:13 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.info Jul 24 15:53:13 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:13 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:13 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "cinder-7f67e208-30f7-42df-a4b3-37515c806de4-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-7f67e208-30f7-42df-a4b3-37515c806de4-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:13 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "cinder-quobyte-7f67e208-30f7-42df-a4b3-37515c806de4" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.info" returned: 0 in 0.590s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:13 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.info is being set with open permissions: ugo+rw Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-7f67e208-30f7-42df-a4b3-37515c806de4" acquired by "delete_volume" :: waited 0.064s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:13 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.info Jul 24 15:53:13 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:13 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.606s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:13 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Deleted volume successfully. Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[428fdeae-5dec-4163-a540-974eedae6039]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f67e208-30f7-42df-a4b3-37515c806de4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-56611027-03e8-400f-ba01-5c85bbb49dc7 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-9ad3ea90-484d-4395-b457-4a15cd12848e-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:14 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f67e208-30f7-42df-a4b3-37515c806de4 Jul 24 15:53:14 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:14 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.info" returned: 0 in 0.476s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.437s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:14 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-9d6e7daf-9805-4fd8-99cc-f17d3716ce3b tempest-VolumesDeleteCascade-1446356427 None] Create snapshot completed successfully Jul 24 15:53:14 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f67e208-30f7-42df-a4b3-37515c806de4" returned: 0 in 0.652s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f67e208-30f7-42df-a4b3-37515c806de4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:14 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f67e208-30f7-42df-a4b3-37515c806de4 Jul 24 15:53:14 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:14 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7f67e208-30f7-42df-a4b3-37515c806de4" returned: 0 in 0.303s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-7f67e208-30f7-42df-a4b3-37515c806de4" released by "delete_volume" :: held 1.041s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:14 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Created reservations ['d588231d-282d-4ad1-814c-767e8c302864', 'db219687-a745-493e-b4d8-602b709ab3f9', 'cfd8dcea-1368-4220-b077-ebf10323d851', 'fe291882-fa99-4416-b4da-6b8f19643a83'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:15 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:15 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:15 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.533s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:15 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:15 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Deleted volume successfully. Jul 24 15:53:15 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-43762b82-3a6b-43bc-9726-16c91b4b245b tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-7f67e208-30f7-42df-a4b3-37515c806de4-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d4a100bd-4a62-4002-9760-0f38c0f34a71 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d4a100bd-4a62-4002-9760-0f38c0f34a71 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d4a100bd-4a62-4002-9760-0f38c0f34a71 tempest-VolumesDeleteCascade-1446356427 None] Creating offline snapshot e07d0d51-71fe-494c-a374-84ebf8fdfa09 of volume 1f4699fd-be72-46bb-a518-99e1bcb2de60 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:53:15 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c164aed-9fdf-4652-afab-55c5d0b1ea8e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d4a100bd-4a62-4002-9760-0f38c0f34a71 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "cinder-4b90a38a-a300-4eee-bf8a-5d96769a479a-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-4b90a38a-a300-4eee-bf8a-5d96769a479a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:16 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 Jul 24 15:53:16 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "cinder-quobyte-4b90a38a-a300-4eee-bf8a-5d96769a479a" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-4b90a38a-a300-4eee-bf8a-5d96769a479a" acquired by "delete_volume" :: waited 0.034s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b241fc7b-ff7f-4b1a-9540-a41ef5031fbb]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4b90a38a-a300-4eee-bf8a-5d96769a479a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:16 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4b90a38a-a300-4eee-bf8a-5d96769a479a Jul 24 15:53:16 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:16 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d4a100bd-4a62-4002-9760-0f38c0f34a71 tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195" returned: 0 in 0.874s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d4a100bd-4a62-4002-9760-0f38c0f34a71 tempest-VolumesDeleteCascade-1446356427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4699fd-be72-46bb-a518-99e1bcb2de60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d4a100bd-4a62-4002-9760-0f38c0f34a71 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:16 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 1G Jul 24 15:53:16 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Flow 'volume_create_manager' (5e78c4cd-13e3-4311-ac58-07bb79726f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852c7407-9030-4fae-8ba5-8c1a1620864e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852c7407-9030-4fae-8ba5-8c1a1620864e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-816833408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f7a1c07-f0b7-44f4-886c-64345b7a5407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cac99ef11c44eeab3f0cc0d3295e254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:17Z,use_quota=True,user_id='cc1f786d80014de79b97b0f57d1e9d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49dec237-62bd-48a1-a085-d9ceab2e1788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49dec237-62bd-48a1-a085-d9ceab2e1788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4b67f4-e098-4b79-8046-0afa1e0e3526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c4b67f4-e098-4b79-8046-0afa1e0e3526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f7a1c07-f0b7-44f4-886c-64345b7a5407', 'volume_name': 'volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5be622c-49f3-4751-a453-043ba6b15eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5be622c-49f3-4751-a453-043ba6b15eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4603d783-78e1-41d5-bdc1-344e0aed4789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:16 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Volume 2f7a1c07-f0b7-44f4-886c-64345b7a5407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407', 'volume_size': 1} Jul 24 15:53:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:17 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4b90a38a-a300-4eee-bf8a-5d96769a479a" returned: 0 in 0.829s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4b90a38a-a300-4eee-bf8a-5d96769a479a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:17 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4b90a38a-a300-4eee-bf8a-5d96769a479a Jul 24 15:53:17 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:17 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d4a100bd-4a62-4002-9760-0f38c0f34a71 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 1G" returned: 0 in 0.639s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d4a100bd-4a62-4002-9760-0f38c0f34a71 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:17 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 Jul 24 15:53:17 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:17 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4b90a38a-a300-4eee-bf8a-5d96769a479a" returned: 0 in 0.321s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-4b90a38a-a300-4eee-bf8a-5d96769a479a" released by "delete_volume" :: held 1.249s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:17 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Created reservations ['72e86276-192a-48e0-932c-bf672bc7d9d2', 'b41ca8ce-8dfd-4560-b5db-60a442cc1a5e', '6816ef70-a5e4-454c-8fa0-0c5eb14d9b72', '8d2ae2a2-8def-4a5b-b02d-6c1828f8f47c'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:17 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:17 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:17 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d4a100bd-4a62-4002-9760-0f38c0f34a71 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09" returned: 0 in 0.437s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:17 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-d4a100bd-4a62-4002-9760-0f38c0f34a71 tempest-VolumesDeleteCascade-1446356427 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 is being set with open permissions: ugo+rw Jul 24 15:53:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d4a100bd-4a62-4002-9760-0f38c0f34a71 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:17 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 Jul 24 15:53:17 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:18 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.327s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:18 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Deleted volume successfully. Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c27944be-c2c7-4b09-8a73-cdeb833a0660 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-4b90a38a-a300-4eee-bf8a-5d96769a479a-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:18 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d4a100bd-4a62-4002-9760-0f38c0f34a71 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09" returned: 0 in 0.373s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d4a100bd-4a62-4002-9760-0f38c0f34a71 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.533s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.308s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-816833408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f7a1c07-f0b7-44f4-886c-64345b7a5407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cac99ef11c44eeab3f0cc0d3295e254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:17Z,use_quota=True,user_id='cc1f786d80014de79b97b0f57d1e9d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Creating volume 2f7a1c07-f0b7-44f4-886c-64345b7a5407 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:18 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:18 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407 1073741824 Jul 24 15:53:18 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:18 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d4a100bd-4a62-4002-9760-0f38c0f34a71 tempest-VolumesDeleteCascade-1446356427 None] Create snapshot completed successfully Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "cinder-4c0774b0-9fa3-4b5f-8edf-b62658a89667-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-4c0774b0-9fa3-4b5f-8edf-b62658a89667-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "cinder-quobyte-4c0774b0-9fa3-4b5f-8edf-b62658a89667" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-4c0774b0-9fa3-4b5f-8edf-b62658a89667" acquired by "delete_volume" :: waited 0.039s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c0728f-9b1c-4c94-92c9-10d50c80feda]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:18 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667 Jul 24 15:53:18 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-1f4699fd-be72-46bb-a518-99e1bcb2de60-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:19 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-1f4699fd-be72-46bb-a518-99e1bcb2de60-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407 1073741824" returned: 0 in 0.787s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Performing cascade delete. {{(pid=88350) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-5cd2d625-9c91-48df-84df-f0c1ac96a195-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:19 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407 Jul 24 15:53:19 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:19 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667" returned: 0 in 0.677s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-5cd2d625-9c91-48df-84df-f0c1ac96a195-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:19 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667 Jul 24 15:53:19 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-quobyte-1f4699fd-be72-46bb-a518-99e1bcb2de60" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-1f4699fd-be72-46bb-a518-99e1bcb2de60" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-quobyte-5cd2d625-9c91-48df-84df-f0c1ac96a195" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-5cd2d625-9c91-48df-84df-f0c1ac96a195" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Deleting offline snapshot 5cd2d625-9c91-48df-84df-f0c1ac96a195 of volume 1f4699fd-be72-46bb-a518-99e1bcb2de60 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] snapshot_file for this snap is: volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[64442381-fdae-4124-88d7-7dd794e2bb15]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:19 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 Jul 24 15:53:19 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:19 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407" returned: 0 in 0.506s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] <== create_volume: return (1408ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4603d783-78e1-41d5-bdc1-344e0aed4789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78189e6-2543-4f65-81f2-a862584e06d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:19 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Volume volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407 (2f7a1c07-f0b7-44f4-886c-64345b7a5407): created successfully Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78189e6-2543-4f65-81f2-a862584e06d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Flow 'volume_create_manager' (5e78c4cd-13e3-4311-ac58-07bb79726f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:19 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-8b7837bb-fdee-46b2-afe0-bc52e00f5bd1 tempest-VolumesActionsTest-1968172073 None] Created volume successfully. Jul 24 15:53:19 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4c0774b0-9fa3-4b5f-8edf-b62658a89667" returned: 0 in 0.589s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-4c0774b0-9fa3-4b5f-8edf-b62658a89667" released by "delete_volume" :: held 1.332s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Created reservations ['8312fef3-676c-4735-9d94-bcf45c03e23e', 'a8f66993-159f-4978-8097-a0522ca175a0', '686af808-a752-4875-910e-e404d11bd3ee', '1895e1ce-981e-4096-bf15-4a3bd91c93bc'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:20 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195" returned: 0 in 0.637s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4699fd-be72-46bb-a518-99e1bcb2de60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3ed613-010c-4bec-bd4e-c6512b3536cc]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:20 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:20 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Acquiring lock "cinder-2f7a1c07-f0b7-44f4-886c-64345b7a5407-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Lock "cinder-2f7a1c07-f0b7-44f4-886c-64345b7a5407-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:20 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 Jul 24 15:53:20 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Acquiring lock "cinder-quobyte-2f7a1c07-f0b7-44f4-886c-64345b7a5407" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Lock "cinder-quobyte-2f7a1c07-f0b7-44f4-886c-64345b7a5407" acquired by "delete_volume" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8d41fd-8a6d-4eb9-ad1c-31a9fda60ffd]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:20 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60" returned: 0 in 0.682s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:20 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407 Jul 24 15:53:20 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:20 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "cinder-becd666f-c50a-46c5-bdf4-8ac8cb48ccb9-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.683s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cb2e21-7bb0-4a18-ac0d-14efca6764a1]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:20 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Deleted volume successfully. Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-becd666f-c50a-46c5-bdf4-8ac8cb48ccb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.089s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "cinder-quobyte-eca4c099-4693-4634-8843-573dc0f473f4" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bdeb23eb-898c-43e7-a4e2-d17303469c42 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-4c0774b0-9fa3-4b5f-8edf-b62658a89667-delete_volume" released by "delete_volume" :: held 2.585s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-eca4c099-4693-4634-8843-573dc0f473f4" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "cinder-quobyte-becd666f-c50a-46c5-bdf4-8ac8cb48ccb9" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-becd666f-c50a-46c5-bdf4-8ac8cb48ccb9" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:21 devstack sudo[100932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 Jul 24 15:53:21 devstack sudo[100932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Deleting offline snapshot becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 of volume eca4c099-4693-4634-8843-573dc0f473f4 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] snapshot_file for this snap is: volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d8507b-1e28-4fad-b9ce-eab79b720a35]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:21 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 Jul 24 15:53:21 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:21 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407" returned: 0 in 0.830s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:21 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407 Jul 24 15:53:21 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Flow 'volume_create_manager' (f2b4b434-1f5c-4423-8fdc-59286cbb077b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bc55f1-8b5e-4bd2-8fe4-5c11f42a1201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bc55f1-8b5e-4bd2-8fe4-5c11f42a1201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-508514210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffc4696-a893-431e-bbf8-416239b04bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3616376560f47c59b955ca73831f2b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:21Z,use_quota=True,user_id='ce52e5a95e444a8fad40f43b478614ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b80dc5-690f-4469-8861-c34a1e8ecdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b80dc5-690f-4469-8861-c34a1e8ecdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5b369b-3a68-4c84-a5e0-44b2719b0497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c5b369b-3a68-4c84-a5e0-44b2719b0497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fffc4696-a893-431e-bbf8-416239b04bc5', 'volume_name': 'volume-fffc4696-a893-431e-bbf8-416239b04bc5', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84e77f1-bfd9-49ea-8676-259f6f37294d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84e77f1-bfd9-49ea-8676-259f6f37294d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18948bba-4140-40ce-92e4-708793f0166b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:21 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Volume fffc4696-a893-431e-bbf8-416239b04bc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fffc4696-a893-431e-bbf8-416239b04bc5', 'volume_size': 1} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-508514210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fffc4696-a893-431e-bbf8-416239b04bc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3616376560f47c59b955ca73831f2b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:21Z,use_quota=True,user_id='ce52e5a95e444a8fad40f43b478614ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Creating volume fffc4696-a893-431e-bbf8-416239b04bc5 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:21 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fffc4696-a893-431e-bbf8-416239b04bc5 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:21 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fffc4696-a893-431e-bbf8-416239b04bc5 1073741824 Jul 24 15:53:21 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:21 devstack sudo[100932]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09" returned: 0 in 0.772s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4699fd-be72-46bb-a518-99e1bcb2de60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[988ed6b8-8f0c-4dde-988d-87b2b0abae8a]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:21 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9" returned: 0 in 0.558s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eca4c099-4693-4634-8843-573dc0f473f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:53:21 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2f7a1c07-f0b7-44f4-886c-64345b7a5407" returned: 0 in 0.436s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f95185-e10d-431a-a87b-1390cf289797]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Lock "cinder-quobyte-2f7a1c07-f0b7-44f4-886c-64345b7a5407" released by "delete_volume" :: held 1.384s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:21 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 Jul 24 15:53:21 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:21 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Created reservations ['5ffd1838-f87f-4718-b07c-5c0dc2ff3206', '75cd4f3d-59ae-4e04-80ed-c0ed7110bae2', '2a112e84-a5f7-48ca-af1e-b2fc8d1d3dc7', 'c6513806-7500-4e77-9a19-30bba9ba9451'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:22 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4 Jul 24 15:53:22 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:22 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:22 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:22 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195" returned: 0 in 0.487s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4699fd-be72-46bb-a518-99e1bcb2de60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56da510-6928-406f-b7d0-2f4bfe2cef63]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:22 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fffc4696-a893-431e-bbf8-416239b04bc5 1073741824" returned: 0 in 0.651s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fffc4696-a893-431e-bbf8-416239b04bc5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:22 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fffc4696-a893-431e-bbf8-416239b04bc5 Jul 24 15:53:22 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:22 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 Jul 24 15:53:22 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:22 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.375s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:22 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Deleted volume successfully. Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-effa90c9-9754-4f6f-b309-10d20ee809af tempest-VolumesActionsTest-1063434863 None] Lock "cinder-2f7a1c07-f0b7-44f4-886c-64345b7a5407-delete_volume" released by "delete_volume" :: held 2.124s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:22 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4" returned: 0 in 0.732s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:22 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 Jul 24 15:53:22 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:22 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60" returned: 0 in 0.482s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:22 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fffc4696-a893-431e-bbf8-416239b04bc5" returned: 0 in 0.408s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:22 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 Jul 24 15:53:22 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18948bba-4140-40ce-92e4-708793f0166b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fffc4696-a893-431e-bbf8-416239b04bc5', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5b3d43-9c7f-4b35-96d0-911bd0639745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:22 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Volume volume-fffc4696-a893-431e-bbf8-416239b04bc5 (fffc4696-a893-431e-bbf8-416239b04bc5): created successfully Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5b3d43-9c7f-4b35-96d0-911bd0639745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Flow 'volume_create_manager' (f2b4b434-1f5c-4423-8fdc-59286cbb077b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:22 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c6225d8e-4bcd-413a-9b86-0a0054ba96ec tempest-TestMinimumBasicScenario-18470097 None] Created volume successfully. Jul 24 15:53:22 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9" returned: 0 in 0.428s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:23 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9 Jul 24 15:53:23 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:23 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195" returned: 0 in 0.458s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:23 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195 Jul 24 15:53:23 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:23 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4.becd666f-c50a-46c5-bdf4-8ac8cb48ccb9" returned: 0 in 0.324s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-becd666f-c50a-46c5-bdf4-8ac8cb48ccb9" released by "_delete_snapshot" :: held 2.262s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-eca4c099-4693-4634-8843-573dc0f473f4" released by "delete_snapshot" :: held 2.317s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Created reservations ['41f0e0ea-b1fc-4065-8ae3-98c7d9c99752', 'bfd3b230-6826-4f87-868c-9f3c6c7f027f', '979f4dc6-ea64-4c8c-a6a5-d677b790211d', 'bed0d0cf-3e7e-4e37-a561-c3aa39e1d8c6'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:23 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:23 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Delete snapshot completed successfully. Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.5cd2d625-9c91-48df-84df-f0c1ac96a195" returned: 0 in 0.541s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 -F qcow2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-05976644-2acb-405a-8060-7bb5c394caac tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-becd666f-c50a-46c5-bdf4-8ac8cb48ccb9-delete_snapshot" released by "delete_snapshot" :: held 2.754s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:23 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 -F qcow2 Jul 24 15:53:23 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Flow 'volume_create_manager' (cc64725b-1e25-4c65-853d-442f5702e1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21ef03d-3805-4aca-961d-0e4af2698db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21ef03d-3805-4aca-961d-0e4af2698db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1061689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896b3c58-c123-402e-9202-fc84fd3eb90a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cac99ef11c44eeab3f0cc0d3295e254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:24Z,use_quota=True,user_id='cc1f786d80014de79b97b0f57d1e9d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5d2bc8-4ec8-4824-837b-451fe3c0c918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5d2bc8-4ec8-4824-837b-451fe3c0c918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d1c9d0-cb97-41c0-a508-bf0b921e826d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d1c9d0-cb97-41c0-a508-bf0b921e826d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '896b3c58-c123-402e-9202-fc84fd3eb90a', 'volume_name': 'volume-896b3c58-c123-402e-9202-fc84fd3eb90a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f644bab8-f536-48a3-8fc0-673e1e063c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f644bab8-f536-48a3-8fc0-673e1e063c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf36df5-e933-42b9-9fc4-358ebac2dc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:23 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Volume 896b3c58-c123-402e-9202-fc84fd3eb90a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-896b3c58-c123-402e-9202-fc84fd3eb90a', 'volume_size': 1} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1061689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=896b3c58-c123-402e-9202-fc84fd3eb90a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cac99ef11c44eeab3f0cc0d3295e254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:24Z,use_quota=True,user_id='cc1f786d80014de79b97b0f57d1e9d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Creating volume 896b3c58-c123-402e-9202-fc84fd3eb90a {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:23 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:53:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-896b3c58-c123-402e-9202-fc84fd3eb90a 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:23 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-896b3c58-c123-402e-9202-fc84fd3eb90a 1073741824 Jul 24 15:53:23 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "cinder-eca4c099-4693-4634-8843-573dc0f473f4-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-eca4c099-4693-4634-8843-573dc0f473f4-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:24 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 -F qcow2" returned: 0 in 0.578s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "cinder-quobyte-eca4c099-4693-4634-8843-573dc0f473f4" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-5cd2d625-9c91-48df-84df-f0c1ac96a195" released by "_delete_snapshot" :: held 4.955s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-1f4699fd-be72-46bb-a518-99e1bcb2de60" released by "delete_snapshot" :: held 5.001s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-eca4c099-4693-4634-8843-573dc0f473f4" acquired by "delete_volume" :: waited 0.043s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa84a572-bed8-443e-bb29-313c95d0e7cb]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Created reservations ['e9aa6d77-057f-4855-b7e9-9c8c7ae78c69', 'a47601b2-b266-4a51-baf7-1c71b4f87a2d', '802d0c45-87fe-454e-b29d-35ffd8bfedf3', 'f3f31816-f75b-4328-b654-f44a43357f6f'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:24 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4 Jul 24 15:53:24 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:24 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-896b3c58-c123-402e-9202-fc84fd3eb90a 1073741824" returned: 0 in 0.689s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-896b3c58-c123-402e-9202-fc84fd3eb90a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:24 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Delete snapshot completed successfully. Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-5cd2d625-9c91-48df-84df-f0c1ac96a195-delete_snapshot" released by "delete_snapshot" :: held 5.460s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-e07d0d51-71fe-494c-a374-84ebf8fdfa09-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:24 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-896b3c58-c123-402e-9202-fc84fd3eb90a Jul 24 15:53:24 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-e07d0d51-71fe-494c-a374-84ebf8fdfa09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-quobyte-1f4699fd-be72-46bb-a518-99e1bcb2de60" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-1f4699fd-be72-46bb-a518-99e1bcb2de60" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-quobyte-e07d0d51-71fe-494c-a374-84ebf8fdfa09" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-e07d0d51-71fe-494c-a374-84ebf8fdfa09" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Deleting offline snapshot e07d0d51-71fe-494c-a374-84ebf8fdfa09 of volume 1f4699fd-be72-46bb-a518-99e1bcb2de60 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:53:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] snapshot_file for this snap is: volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab1fc68-f7c0-4575-b00a-b7adfe9431e3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:25 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4" returned: 0 in 0.580s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:25 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4 Jul 24 15:53:25 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:25 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 Jul 24 15:53:25 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:25 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-896b3c58-c123-402e-9202-fc84fd3eb90a" returned: 0 in 0.586s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf36df5-e933-42b9-9fc4-358ebac2dc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-896b3c58-c123-402e-9202-fc84fd3eb90a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ed4fff-67af-4850-b25c-c4bcac122003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:25 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Volume volume-896b3c58-c123-402e-9202-fc84fd3eb90a (896b3c58-c123-402e-9202-fc84fd3eb90a): created successfully Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ed4fff-67af-4850-b25c-c4bcac122003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Flow 'volume_create_manager' (cc64725b-1e25-4c65-853d-442f5702e1e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:25 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eca4c099-4693-4634-8843-573dc0f473f4" returned: 0 in 0.435s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:25 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d021ee50-d16c-4b0c-902b-5d1ea7c27eea tempest-VolumesActionsTest-1968172073 None] Created volume successfully. Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-832dd2d0-ead2-4390-bbfc-75dcf2854225 req-e4a3d3e0-3be4-4fb3-8728-d2c5f9e24293 tempest-TestMinimumBasicScenario-18470097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-832dd2d0-ead2-4390-bbfc-75dcf2854225 req-e4a3d3e0-3be4-4fb3-8728-d2c5f9e24293 tempest-TestMinimumBasicScenario-18470097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-quobyte-eca4c099-4693-4634-8843-573dc0f473f4" released by "delete_volume" :: held 1.118s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-832dd2d0-ead2-4390-bbfc-75dcf2854225 req-e4a3d3e0-3be4-4fb3-8728-d2c5f9e24293 tempest-TestMinimumBasicScenario-18470097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-832dd2d0-ead2-4390-bbfc-75dcf2854225 req-e4a3d3e0-3be4-4fb3-8728-d2c5f9e24293 tempest-TestMinimumBasicScenario-18470097 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-fffc4696-a893-431e-bbf8-416239b04bc5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd80fad20-0978-4626-9caf-10ec42a1922c', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Created reservations ['fef01d17-eb93-4f7c-a3f3-dd9052a8cc78', 'c38f9695-26bc-4dd3-971a-d6ca26716806', 'a11ec26f-ff24-4a02-8665-904bee861b45', '10a5468d-5e7e-4596-b213-cd7f65759052'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:25 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09" returned: 0 in 0.656s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f4699fd-be72-46bb-a518-99e1bcb2de60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f8a510-1b9b-477f-bfe7-a039de3dffcd]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:25 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-832dd2d0-ead2-4390-bbfc-75dcf2854225 req-e4a3d3e0-3be4-4fb3-8728-d2c5f9e24293 tempest-TestMinimumBasicScenario-18470097 None] attachment_update completed successfully. Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:25 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:25 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:25 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 Jul 24 15:53:25 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Acquiring lock "cinder-896b3c58-c123-402e-9202-fc84fd3eb90a-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:26 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.407s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:26 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Lock "cinder-896b3c58-c123-402e-9202-fc84fd3eb90a-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:26 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Deleted volume successfully. Jul 24 15:53:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7f7f6461-0f11-4494-826a-ead9a6eb5123 tempest-CreateVolumesFromSnapshotTest-1202224260 None] Lock "cinder-eca4c099-4693-4634-8843-573dc0f473f4-delete_volume" released by "delete_volume" :: held 2.127s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Acquiring lock "cinder-quobyte-896b3c58-c123-402e-9202-fc84fd3eb90a" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Lock "cinder-quobyte-896b3c58-c123-402e-9202-fc84fd3eb90a" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:26 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e139f340-d7fe-471e-835c-0651b63a0006]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-896b3c58-c123-402e-9202-fc84fd3eb90a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:26 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60" returned: 0 in 0.752s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:26 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 Jul 24 15:53:26 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:26 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-896b3c58-c123-402e-9202-fc84fd3eb90a Jul 24 15:53:26 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:26 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-896b3c58-c123-402e-9202-fc84fd3eb90a" returned: 0 in 0.467s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-896b3c58-c123-402e-9202-fc84fd3eb90a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:26 devstack sudo[101439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-896b3c58-c123-402e-9202-fc84fd3eb90a Jul 24 15:53:26 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:26 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09" returned: 0 in 0.491s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:27 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09 Jul 24 15:53:27 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:27 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:27 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-896b3c58-c123-402e-9202-fc84fd3eb90a" returned: 0 in 0.585s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60.e07d0d51-71fe-494c-a374-84ebf8fdfa09" returned: 0 in 0.512s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Lock "cinder-quobyte-896b3c58-c123-402e-9202-fc84fd3eb90a" released by "delete_volume" :: held 1.166s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-e07d0d51-71fe-494c-a374-84ebf8fdfa09" released by "_delete_snapshot" :: held 2.599s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-1f4699fd-be72-46bb-a518-99e1bcb2de60" released by "delete_snapshot" :: held 2.666s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Created reservations ['f85fe855-3dd7-4ead-b51a-0ce1d9569839', '226e9022-851b-41ca-acac-bed1f23d7898', '6e5e0299-e2a9-4061-8e6a-bcfa18dc02a9', '3f86ca99-f83e-4ffe-bf2e-856ff89a5131'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Created reservations ['e42f1333-7931-49c0-9947-2eed54279cd4', 'd9ae3bd6-c968-460a-8215-e8adb5536f51', '480235ab-e849-49c0-87c2-db7d25b38f66', '7c0ce433-f7e0-4c4b-bdf3-2822e5055cb1'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:27 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:27 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Delete snapshot completed successfully. Jul 24 15:53:27 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-e07d0d51-71fe-494c-a374-84ebf8fdfa09-delete_snapshot" released by "delete_snapshot" :: held 2.999s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Snapshots deleted, issuing volume delete {{(pid=88350) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-quobyte-1f4699fd-be72-46bb-a518-99e1bcb2de60" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-1f4699fd-be72-46bb-a518-99e1bcb2de60" acquired by "delete_volume" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a72aeb-0926-49de-9fd3-7b8743757dce]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:28 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:28 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 Jul 24 15:53:28 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.361s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:28 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:28 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Deleted volume successfully. Jul 24 15:53:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-19703a5a-5dc8-4d64-b44c-26f066cc50fe tempest-VolumesActionsTest-1063434863 None] Lock "cinder-896b3c58-c123-402e-9202-fc84fd3eb90a-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:28 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60" returned: 0 in 0.705s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:28 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60 Jul 24 15:53:28 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:29 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1f4699fd-be72-46bb-a518-99e1bcb2de60" returned: 0 in 0.372s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-1f4699fd-be72-46bb-a518-99e1bcb2de60" released by "delete_volume" :: held 1.248s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Created reservations ['8e3187a8-66ee-4dd9-8ba2-7f3997e6c5fa', '78c2e402-99a2-45fc-ae7f-24dfcb775851', '63e3ce4f-24ee-420c-a164-a7f1730ad698', '244100d3-69a4-44f4-9814-58f137d7c831'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:29 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:29 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Flow 'volume_create_manager' (584340f9-5a2e-4879-8dbb-70f8c106f7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5544a799-329f-4669-a290-dadd7d57be64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5544a799-329f-4669-a290-dadd7d57be64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-40296361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a62ad7d-55db-46b5-87c1-172f84efba82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cac99ef11c44eeab3f0cc0d3295e254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:29Z,use_quota=True,user_id='cc1f786d80014de79b97b0f57d1e9d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2012977-f921-4060-adf5-ed1d2b72a03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2012977-f921-4060-adf5-ed1d2b72a03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a910e73f-3302-486b-8f2b-588268fe04f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a910e73f-3302-486b-8f2b-588268fe04f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a62ad7d-55db-46b5-87c1-172f84efba82', 'volume_name': 'volume-8a62ad7d-55db-46b5-87c1-172f84efba82', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31efbf02-cca5-4296-b5e4-980ad9a768d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31efbf02-cca5-4296-b5e4-980ad9a768d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00a26e5-fc32-45cb-a8bf-36149370ce6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:29 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Volume 8a62ad7d-55db-46b5-87c1-172f84efba82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a62ad7d-55db-46b5-87c1-172f84efba82', 'volume_size': 1} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-40296361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a62ad7d-55db-46b5-87c1-172f84efba82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cac99ef11c44eeab3f0cc0d3295e254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:29Z,use_quota=True,user_id='cc1f786d80014de79b97b0f57d1e9d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Creating volume 8a62ad7d-55db-46b5-87c1-172f84efba82 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:29 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8a62ad7d-55db-46b5-87c1-172f84efba82 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:29 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.493s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:29 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:29 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Deleted volume successfully. Jul 24 15:53:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b7889973-83fa-44aa-a12d-cf3e5c3fd2a5 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-1f4699fd-be72-46bb-a518-99e1bcb2de60-delete_volume" released by "delete_volume" :: held 10.920s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:30 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8a62ad7d-55db-46b5-87c1-172f84efba82 1073741824 Jul 24 15:53:30 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:30 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Flow 'volume_create_manager' (7e5efc64-4aab-4f56-a96f-beab16420fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6824504-c72b-4892-bab8-69e16c185ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:30 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6824504-c72b-4892-bab8-69e16c185ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-652062963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3692f3eb-d3b9-45aa-93b6-3e6d00889939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b87533f96224770abb1cfa38a954b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:31Z,use_quota=True,user_id='2ab16052431c46f9bc6046a579c10730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222ff23a-decd-4fb3-8233-f82fa21b062c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (222ff23a-decd-4fb3-8233-f82fa21b062c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbf6348-4491-41ea-bd39-5ab68542408f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbf6348-4491-41ea-bd39-5ab68542408f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3692f3eb-d3b9-45aa-93b6-3e6d00889939', 'volume_name': 'volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9a315e-b65b-4384-b132-dd948a47167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9a315e-b65b-4384-b132-dd948a47167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3566f8b3-9053-467d-ab6e-2da3245469cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:30 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Volume 3692f3eb-d3b9-45aa-93b6-3e6d00889939: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939', 'volume_size': 1} Jul 24 15:53:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8a62ad7d-55db-46b5-87c1-172f84efba82 1073741824" returned: 0 in 1.046s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8a62ad7d-55db-46b5-87c1-172f84efba82 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:31 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8a62ad7d-55db-46b5-87c1-172f84efba82 Jul 24 15:53:31 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:31 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8a62ad7d-55db-46b5-87c1-172f84efba82" returned: 0 in 0.411s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.482s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-652062963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3692f3eb-d3b9-45aa-93b6-3e6d00889939,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b87533f96224770abb1cfa38a954b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:31Z,use_quota=True,user_id='2ab16052431c46f9bc6046a579c10730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Creating volume 3692f3eb-d3b9-45aa-93b6-3e6d00889939 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:31 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b00a26e5-fc32-45cb-a8bf-36149370ce6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a62ad7d-55db-46b5-87c1-172f84efba82', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:31 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 1073741824 Jul 24 15:53:31 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed53be47-377e-4a54-aa68-f2d0e5dfb6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:31 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Volume volume-8a62ad7d-55db-46b5-87c1-172f84efba82 (8a62ad7d-55db-46b5-87c1-172f84efba82): created successfully Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed53be47-377e-4a54-aa68-f2d0e5dfb6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Flow 'volume_create_manager' (584340f9-5a2e-4879-8dbb-70f8c106f7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:31 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1a69017d-ccc0-4b4c-95d4-4d059c7ae054 tempest-VolumesActionsTest-1968172073 None] Created volume successfully. Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Flow 'volume_create_manager' (1eb9db6d-e710-44eb-9a64-039e62127afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e99c53-f41c-43fe-acd1-77734bd8a8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e99c53-f41c-43fe-acd1-77734bd8a8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-113687135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa99975e-284f-43f9-b968-8c4cbe2a28f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e26fc493321424faddcb9a471cee262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:32Z,use_quota=True,user_id='8d6de31d55d74f8282efdc48519246dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:31 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b36f86-54cf-49ea-a8c6-c6932f147fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b36f86-54cf-49ea-a8c6-c6932f147fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4656a668-e239-4cf9-a9a8-accc11553e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4656a668-e239-4cf9-a9a8-accc11553e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa99975e-284f-43f9-b968-8c4cbe2a28f6', 'volume_name': 'volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a086873e-6fa1-4980-aa62-9026fb27a1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a086873e-6fa1-4980-aa62-9026fb27a1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90dbe1c-51df-4031-9ea6-52d50f235c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:32 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Volume fa99975e-284f-43f9-b968-8c4cbe2a28f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6', 'volume_size': 1} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:32 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 1073741824" returned: 0 in 0.709s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:32 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 Jul 24 15:53:32 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:32 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939" returned: 0 in 0.257s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.434s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-113687135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa99975e-284f-43f9-b968-8c4cbe2a28f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e26fc493321424faddcb9a471cee262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:32Z,use_quota=True,user_id='8d6de31d55d74f8282efdc48519246dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Creating volume fa99975e-284f-43f9-b968-8c4cbe2a28f6 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:32 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3566f8b3-9053-467d-ab6e-2da3245469cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:32 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 1073741824 Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb93f94-b227-40fa-8350-2d62e96f45d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:32 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:32 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Volume volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 (3692f3eb-d3b9-45aa-93b6-3e6d00889939): created successfully Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb93f94-b227-40fa-8350-2d62e96f45d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Flow 'volume_create_manager' (7e5efc64-4aab-4f56-a96f-beab16420fbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:32 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-df1acfb6-0ed0-4deb-b36e-280d54883a97 tempest-VolumesDeleteCascade-1446356427 None] Created volume successfully. Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Acquiring lock "cinder-8a62ad7d-55db-46b5-87c1-172f84efba82-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Lock "cinder-8a62ad7d-55db-46b5-87c1-172f84efba82-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Acquiring lock "cinder-quobyte-8a62ad7d-55db-46b5-87c1-172f84efba82" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Lock "cinder-quobyte-8a62ad7d-55db-46b5-87c1-172f84efba82" acquired by "delete_volume" :: waited 0.029s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:33 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 1073741824" returned: 0 in 0.634s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a89fba-d46b-4fce-998b-ac3f3b48b053]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8a62ad7d-55db-46b5-87c1-172f84efba82 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:33 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8a62ad7d-55db-46b5-87c1-172f84efba82 Jul 24 15:53:33 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:33 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 Jul 24 15:53:33 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:33 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6" returned: 0 in 0.307s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.266s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90dbe1c-51df-4031-9ea6-52d50f235c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe94e34-ab85-4b69-92f3-157fa414cfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] Creating offline snapshot 02c29738-2a90-42d7-a3e1-cf6b9341e28d of volume 3692f3eb-d3b9-45aa-93b6-3e6d00889939 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:53:33 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Volume volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 (fa99975e-284f-43f9-b968-8c4cbe2a28f6): created successfully Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbe94e34-ab85-4b69-92f3-157fa414cfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Flow 'volume_create_manager' (1eb9db6d-e710-44eb-9a64-039e62127afc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[458df4fa-2944-45b2-a3c5-220588c3b2bb]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:33 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a48a23cc-e9be-43ba-b4ed-1646e8963748 tempest-VolumeDependencyTests-954178699 None] Created volume successfully. Jul 24 15:53:33 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8a62ad7d-55db-46b5-87c1-172f84efba82" returned: 0 in 0.545s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8a62ad7d-55db-46b5-87c1-172f84efba82 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:33 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8a62ad7d-55db-46b5-87c1-172f84efba82 Jul 24 15:53:33 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:33 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 Jul 24 15:53:33 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:34 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8a62ad7d-55db-46b5-87c1-172f84efba82" returned: 0 in 0.426s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Lock "cinder-quobyte-8a62ad7d-55db-46b5-87c1-172f84efba82" released by "delete_volume" :: held 1.049s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:34 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939" returned: 0 in 0.536s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:34 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d 1G Jul 24 15:53:34 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Created reservations ['c1cb7158-e453-4815-bb1f-14de15f198fd', 'ea60e015-a716-4a24-93a8-ff972b6a0184', 'd6fe26cf-0807-4b8c-b4c3-3f1bdcf6c06b', '57ab79db-520e-4913-9c5f-1ebe5b2a3f4c'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:34 devstack sudo[101538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:34 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:34 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.282s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:34 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Deleted volume successfully. Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cc0726ed-dd72-4745-b00e-257f6961d9fa tempest-VolumesActionsTest-1063434863 None] Lock "cinder-8a62ad7d-55db-46b5-87c1-172f84efba82-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:34 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d 1G" returned: 0 in 0.560s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:34 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d Jul 24 15:53:34 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:35 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d" returned: 0 in 0.355s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:35 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d is being set with open permissions: ugo+rw Jul 24 15:53:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:35 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d Jul 24 15:53:35 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:35 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d" returned: 0 in 0.348s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:35 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.info Jul 24 15:53:35 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:35 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.info" returned: 0 in 0.314s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:35 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.info is being set with open permissions: ugo+rw Jul 24 15:53:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:35 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.info Jul 24 15:53:35 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:35 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Flow 'volume_create_manager' (d0d12ba7-0d0d-480f-8ba4-93780de7a093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdca6e9-5521-48bf-b248-2e2ac935285f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdca6e9-5521-48bf-b248-2e2ac935285f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2024531222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0d216b-efca-4883-a8b9-c9924509a677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cac99ef11c44eeab3f0cc0d3295e254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:36Z,use_quota=True,user_id='cc1f786d80014de79b97b0f57d1e9d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8f7bc3-b1ee-47ac-8b7d-768f72ab1acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8f7bc3-b1ee-47ac-8b7d-768f72ab1acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae57f038-4ce1-4af3-8940-1a52c9dce540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae57f038-4ce1-4af3-8940-1a52c9dce540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a0d216b-efca-4883-a8b9-c9924509a677', 'volume_name': 'volume-1a0d216b-efca-4883-a8b9-c9924509a677', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a66596e-1bf3-4320-957e-7a45670b7279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a66596e-1bf3-4320-957e-7a45670b7279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b614deb1-575e-47b2-8c49-31b73d8e936b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:36 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Volume 1a0d216b-efca-4883-a8b9-c9924509a677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a0d216b-efca-4883-a8b9-c9924509a677', 'volume_size': 1} Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:36 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.info" returned: 0 in 0.279s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.546s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.797s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] Creating offline snapshot d995259a-7c08-4427-a626-9ce0d9ab6399 of volume fa99975e-284f-43f9-b968-8c4cbe2a28f6 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:53:36 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-bed9df1e-4b03-407c-b745-eaeb6e26b630 tempest-VolumesDeleteCascade-1446356427 None] Create snapshot completed successfully Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05174bd-d8ff-482b-aeb0-1a28958c328f]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:36 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 Jul 24 15:53:36 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:36 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6" returned: 0 in 0.414s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:36 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 1G Jul 24 15:53:36 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:37 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 1G" returned: 0 in 0.538s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:37 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 Jul 24 15:53:37 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Flow 'volume_create_manager' (6691fed9-9a99-4302-9cae-185575928f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83121d27-ebed-43b1-aca5-03770cbffb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83121d27-ebed-43b1-aca5-03770cbffb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1956304093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c3a0dc-7b13-47f8-accd-529e10d11048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b87533f96224770abb1cfa38a954b8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=02c29738-2a90-42d7-a3e1-cf6b9341e28d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:37Z,use_quota=True,user_id='2ab16052431c46f9bc6046a579c10730',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9dc340-3696-4da3-bbbd-7cc7fb9f8b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9dc340-3696-4da3-bbbd-7cc7fb9f8b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d2344d-b257-4806-bbb2-ae44bc41d6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d2344d-b257-4806-bbb2-ae44bc41d6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a3c3a0dc-7b13-47f8-accd-529e10d11048', 'volume_name': 'volume-a3c3a0dc-7b13-47f8-accd-529e10d11048', 'volume_size': 1, 'snapshot_id': '02c29738-2a90-42d7-a3e1-cf6b9341e28d'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1103b68f-5cc1-49ef-8882-d7db7e8be43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1103b68f-5cc1-49ef-8882-d7db7e8be43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bffb7b-d78d-4a37-8b22-bbc0749bb1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:37 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Volume a3c3a0dc-7b13-47f8-accd-529e10d11048: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a3c3a0dc-7b13-47f8-accd-529e10d11048', 'volume_size': 1, 'snapshot_id': '02c29738-2a90-42d7-a3e1-cf6b9341e28d'} Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:37 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399" returned: 0 in 0.394s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:37 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 is being set with open permissions: ugo+rw Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:37 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 Jul 24 15:53:37 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:37 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399" returned: 0 in 0.269s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:37 devstack sudo[101588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.info Jul 24 15:53:37 devstack sudo[101588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:38 devstack sudo[101588]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.info" returned: 0 in 0.292s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:38 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.info is being set with open permissions: ugo+rw Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:38 devstack sudo[101591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.info Jul 24 15:53:38 devstack sudo[101591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:38 devstack sudo[101591]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.info" returned: 0 in 0.262s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.280s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.331s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2024531222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0d216b-efca-4883-a8b9-c9924509a677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cac99ef11c44eeab3f0cc0d3295e254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:36Z,use_quota=True,user_id='cc1f786d80014de79b97b0f57d1e9d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Creating volume 1a0d216b-efca-4883-a8b9-c9924509a677 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:38 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1a0d216b-efca-4883-a8b9-c9924509a677 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:38 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1a0d216b-efca-4883-a8b9-c9924509a677 1073741824 Jul 24 15:53:38 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:38 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-0942e658-3027-4b6d-b48e-ec4043ca4a72 tempest-VolumeDependencyTests-954178699 None] Create snapshot completed successfully Jul 24 15:53:38 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1a0d216b-efca-4883-a8b9-c9924509a677 1073741824" returned: 0 in 0.441s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1a0d216b-efca-4883-a8b9-c9924509a677 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:38 devstack sudo[101599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1a0d216b-efca-4883-a8b9-c9924509a677 Jul 24 15:53:38 devstack sudo[101599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:39 devstack sudo[101599]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1a0d216b-efca-4883-a8b9-c9924509a677" returned: 0 in 0.263s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.879s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-quobyte-02c29738-2a90-42d7-a3e1-cf6b9341e28d-a3c3a0dc-7b13-47f8-accd-529e10d11048" by "_create_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b614deb1-575e-47b2-8c49-31b73d8e936b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a0d216b-efca-4883-a8b9-c9924509a677', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e954df-4ba2-4d63-a37a-1fc23a80e931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-02c29738-2a90-42d7-a3e1-cf6b9341e28d-a3c3a0dc-7b13-47f8-accd-529e10d11048" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Creating volume a3c3a0dc-7b13-47f8-accd-529e10d11048 from snapshot 02c29738-2a90-42d7-a3e1-cf6b9341e28d {{(pid=88350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-quobyte-a3c3a0dc-7b13-47f8-accd-529e10d11048" by "_copy_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:39 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Volume volume-1a0d216b-efca-4883-a8b9-c9924509a677 (1a0d216b-efca-4883-a8b9-c9924509a677): created successfully Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e954df-4ba2-4d63-a37a-1fc23a80e931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Flow 'volume_create_manager' (d0d12ba7-0d0d-480f-8ba4-93780de7a093) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-a3c3a0dc-7b13-47f8-accd-529e10d11048" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] snapshot: 02c29738-2a90-42d7-a3e1-cf6b9341e28d, volume: a3c3a0dc-7b13-47f8-accd-529e10d11048, {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:53:39 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-119dc962-a3c3-4776-ace8-1a489dee8e3c tempest-VolumesActionsTest-1968172073 None] Created volume successfully. Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6dbc53-d617-4349-92c4-fa1bb05af597]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:39 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d Jul 24 15:53:39 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:39 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d" returned: 0 in 0.388s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Creating direct copy from snapshot {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e11bdbf-ce8a-499e-a4a9-a73826e070ce]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:39 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 Jul 24 15:53:39 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:40 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:40 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:40 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939" returned: 0 in 0.634s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.utils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Path /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a3c3a0dc-7b13-47f8-accd-529e10d11048 not found in is_blk_device check {{(pid=88350) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a3c3a0dc-7b13-47f8-accd-529e10d11048 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:40 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a3c3a0dc-7b13-47f8-accd-529e10d11048 Jul 24 15:53:40 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Flow 'volume_create_manager' (27c19f4a-74f6-4a26-9c34-ffdf2614c4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1665a0-e716-40ba-8e97-ee5cec990b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1665a0-e716-40ba-8e97-ee5cec990b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-431445248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e26fc493321424faddcb9a471cee262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d995259a-7c08-4427-a626-9ce0d9ab6399,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:40Z,use_quota=True,user_id='8d6de31d55d74f8282efdc48519246dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e452166-0261-4b1f-a9d4-5a538e9a0478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:40 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e452166-0261-4b1f-a9d4-5a538e9a0478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b2a139-256c-416c-8edf-291bf47e71de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b2a139-256c-416c-8edf-291bf47e71de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa', 'volume_name': 'volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa', 'volume_size': 1, 'snapshot_id': 'd995259a-7c08-4427-a626-9ce0d9ab6399'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2a5101-abe4-49c1-9986-09c59b3b1fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2a5101-abe4-49c1-9986-09c59b3b1fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d9ff36-28a8-48cf-a095-1edf1cdc73af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:40 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Volume f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa', 'volume_size': 1, 'snapshot_id': 'd995259a-7c08-4427-a626-9ce0d9ab6399'} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Acquiring lock "cinder-1a0d216b-efca-4883-a8b9-c9924509a677-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.550s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Lock "cinder-1a0d216b-efca-4883-a8b9-c9924509a677-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Acquiring lock "cinder-quobyte-1a0d216b-efca-4883-a8b9-c9924509a677" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Lock "cinder-quobyte-1a0d216b-efca-4883-a8b9-c9924509a677" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d7b5cb-d6a9-4043-89f9-d33f6dc8d89d]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1a0d216b-efca-4883-a8b9-c9924509a677 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:40 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1a0d216b-efca-4883-a8b9-c9924509a677 Jul 24 15:53:40 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:41 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1a0d216b-efca-4883-a8b9-c9924509a677" returned: 0 in 0.642s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1a0d216b-efca-4883-a8b9-c9924509a677 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:41 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1a0d216b-efca-4883-a8b9-c9924509a677 Jul 24 15:53:41 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:41 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1a0d216b-efca-4883-a8b9-c9924509a677" returned: 0 in 0.567s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Lock "cinder-quobyte-1a0d216b-efca-4883-a8b9-c9924509a677" released by "delete_volume" :: held 1.293s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:42 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Created reservations ['a6f7acdb-165f-427b-958e-361308bbad46', '99247e85-5227-4f4b-af24-8ceb4a1e67d8', '4d1c29b3-ecf8-458d-9592-08dbb6d3fba7', 'f6223ad3-bb05-4ff1-a8cb-c4321f517d6c'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:42 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:42 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:42 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.477s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:42 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:42 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Deleted volume successfully. Jul 24 15:53:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-875ccbc8-bc71-4ab5-940c-ea6cdad7c887 tempest-VolumesActionsTest-1063434863 None] Lock "cinder-1a0d216b-efca-4883-a8b9-c9924509a677-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:44 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=168,cinder:SELECT=134,cinder:INSERT=46,cinder:DELETE=12 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:53:44 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=148,cinder:UPDATE=175,cinder:DELETE=20,cinder:INSERT=35 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:53:44 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:53:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Flow 'volume_create_manager' (9968b04b-5dec-4332-a211-e5c67eb52420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bce4190-8b8b-4b4b-bd41-fb8c5ec94aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bce4190-8b8b-4b4b-bd41-fb8c5ec94aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-861937622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570e7c9b-4252-4cc9-9f20-f77f129a0fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cac99ef11c44eeab3f0cc0d3295e254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:44Z,use_quota=True,user_id='cc1f786d80014de79b97b0f57d1e9d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17dbb21-2bc4-4bd1-a059-949bab69850e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17dbb21-2bc4-4bd1-a059-949bab69850e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137e47b2-fa4a-4b0c-8574-fc2d554f1480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (137e47b2-fa4a-4b0c-8574-fc2d554f1480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '570e7c9b-4252-4cc9-9f20-f77f129a0fec', 'volume_name': 'volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0973df6-29f4-4046-8611-005c90f756a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0973df6-29f4-4046-8611-005c90f756a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b33b73-3f36-463a-930d-72dba82b2a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:44 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Volume 570e7c9b-4252-4cc9-9f20-f77f129a0fec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec', 'volume_size': 1} Jul 24 15:53:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:45 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a3c3a0dc-7b13-47f8-accd-529e10d11048" returned: 0 in 5.526s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:45 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[58da696b-19ba-4274-a53b-2acde45cb4a9]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:45 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 Jul 24 15:53:45 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:46 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939" returned: 0 in 0.551s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Image conversion details: src /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939, size 1024.00 MB, duration 5.53 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a3c3a0dc-7b13-47f8-accd-529e10d11048 {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:53:46 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Converted 1024.00 MB image at 185.29 MB/s Jul 24 15:53:46 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a3c3a0dc-7b13-47f8-accd-529e10d11048 is being set with open permissions: ugo+rw Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a3c3a0dc-7b13-47f8-accd-529e10d11048 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:46 devstack sudo[101703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a3c3a0dc-7b13-47f8-accd-529e10d11048 Jul 24 15:53:46 devstack sudo[101703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:46 devstack sudo[101703]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a3c3a0dc-7b13-47f8-accd-529e10d11048" returned: 0 in 0.249s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-a3c3a0dc-7b13-47f8-accd-529e10d11048" released by "_copy_volume_from_snapshot" :: held 7.457s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-02c29738-2a90-42d7-a3e1-cf6b9341e28d-a3c3a0dc-7b13-47f8-accd-529e10d11048" released by "_create_volume_from_snapshot" :: held 7.511s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.559s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.126s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "cinder-quobyte-d995259a-7c08-4427-a626-9ce0d9ab6399-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa" by "_create_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-quobyte-d995259a-7c08-4427-a626-9ce0d9ab6399-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Creating volume f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa from snapshot d995259a-7c08-4427-a626-9ce0d9ab6399 {{(pid=88350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "cinder-quobyte-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa" by "_copy_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89bffb7b-d78d-4a37-8b22-bbc0749bb1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c3a0dc-7b13-47f8-accd-529e10d11048', 'volume_size': 1, 'snapshot_id': '02c29738-2a90-42d7-a3e1-cf6b9341e28d'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c39008-333f-47e6-bab1-51c6f5e7050b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-quobyte-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] snapshot: d995259a-7c08-4427-a626-9ce0d9ab6399, volume: f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa, {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:53:46 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Volume volume-a3c3a0dc-7b13-47f8-accd-529e10d11048 (a3c3a0dc-7b13-47f8-accd-529e10d11048): created successfully Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c39008-333f-47e6-bab1-51c6f5e7050b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Flow 'volume_create_manager' (6691fed9-9a99-4302-9cae-185575928f06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:46 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e322bead-d8ab-4ce5-b4c7-abe3926813ab tempest-VolumesDeleteCascade-1446356427 None] Created volume successfully. Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[70360563-06f6-4162-8b9f-b0a8e8366a62]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:46 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 Jul 24 15:53:46 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-3692f3eb-d3b9-45aa-93b6-3e6d00889939-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-3692f3eb-d3b9-45aa-93b6-3e6d00889939-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Performing cascade delete. {{(pid=88350) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-02c29738-2a90-42d7-a3e1-cf6b9341e28d-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-02c29738-2a90-42d7-a3e1-cf6b9341e28d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-quobyte-3692f3eb-d3b9-45aa-93b6-3e6d00889939" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:47 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399" returned: 0 in 0.543s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Creating direct copy from snapshot {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-3692f3eb-d3b9-45aa-93b6-3e6d00889939" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-quobyte-02c29738-2a90-42d7-a3e1-cf6b9341e28d" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f4e18e-556c-4ca1-81c1-e3540ac3fc73]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-02c29738-2a90-42d7-a3e1-cf6b9341e28d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Deleting offline snapshot 02c29738-2a90-42d7-a3e1-cf6b9341e28d of volume 3692f3eb-d3b9-45aa-93b6-3e6d00889939 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] snapshot_file for this snap is: volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5879a2fd-ecb1-464d-8fc3-fe3b8da48228]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:47 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 Jul 24 15:53:47 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:47 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d Jul 24 15:53:47 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:47 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6" returned: 0 in 0.472s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.utils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Path /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa not found in is_blk_device check {{(pid=88350) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:47 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa Jul 24 15:53:47 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:47 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d" returned: 0 in 0.495s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6a7521-eb2b-40e1-849e-d89832001146]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:48 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 Jul 24 15:53:48 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:48 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939" returned: 0 in 0.698s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:48 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d Jul 24 15:53:48 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:49 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d" returned: 0 in 1.227s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:49 devstack sudo[101761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d Jul 24 15:53:49 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:50 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939.02c29738-2a90-42d7-a3e1-cf6b9341e28d" returned: 0 in 0.794s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:50 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-02c29738-2a90-42d7-a3e1-cf6b9341e28d" released by "_delete_snapshot" :: held 3.400s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:50 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-3692f3eb-d3b9-45aa-93b6-3e6d00889939" released by "delete_snapshot" :: held 3.444s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:50 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Created reservations ['1a7368cc-be44-42c1-8cbe-aa4049c68458', '049eb47e-013c-4a7f-8e08-ace3dd8d63cb', '56cefb49-e406-44d6-a864-de4552db7e0a', 'a9ce9816-a903-4c78-962a-7ad6c4f9ce6b'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:51 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Delete snapshot completed successfully. Jul 24 15:53:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-02c29738-2a90-42d7-a3e1-cf6b9341e28d-delete_snapshot" released by "delete_snapshot" :: held 3.805s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Snapshots deleted, issuing volume delete {{(pid=88350) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 24 15:53:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-quobyte-3692f3eb-d3b9-45aa-93b6-3e6d00889939" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-3692f3eb-d3b9-45aa-93b6-3e6d00889939" acquired by "delete_volume" :: waited 0.040s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:51 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf6c0a3-2202-41a4-9ca0-b2d7d42f4da8]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:51 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 Jul 24 15:53:51 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:52 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939" returned: 0 in 0.931s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:52 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939 Jul 24 15:53:52 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:53 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-3692f3eb-d3b9-45aa-93b6-3e6d00889939" returned: 0 in 0.792s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-3692f3eb-d3b9-45aa-93b6-3e6d00889939" released by "delete_volume" :: held 1.889s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:53 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Created reservations ['15e49714-81bf-45cc-8ed8-52ffd8d10f80', '2ad2ab1a-39ee-498d-87a5-f85db5e86904', '0f013769-d635-4d25-bb40-34a578ea164c', 'dfef6321-79a1-4c9e-a968-6b788a5a9bae'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:53 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:53 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:53 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa" returned: 0 in 5.825s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:53 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d8d233-ae0e-46b7-bda0-1fae2edc1e11]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:53 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 Jul 24 15:53:53 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:53 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.328s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:53 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:53 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Deleted volume successfully. Jul 24 15:53:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5765e66f-0066-41f5-b274-8a3a336dd42c tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-3692f3eb-d3b9-45aa-93b6-3e6d00889939-delete_volume" released by "delete_volume" :: held 6.626s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:54 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6" returned: 0 in 0.562s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Image conversion details: src /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:53:54 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Converted 1024.00 MB image at 175.73 MB/s Jul 24 15:53:54 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa is being set with open permissions: ugo+rw Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:54 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa Jul 24 15:53:54 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-a3c3a0dc-7b13-47f8-accd-529e10d11048-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:54 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa" returned: 0 in 0.276s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-a3c3a0dc-7b13-47f8-accd-529e10d11048-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-quobyte-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa" released by "_copy_volume_from_snapshot" :: held 7.810s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-quobyte-d995259a-7c08-4427-a626-9ce0d9ab6399-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa" released by "_create_volume_from_snapshot" :: held 7.867s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.895s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.216s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:53:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-861937622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570e7c9b-4252-4cc9-9f20-f77f129a0fec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cac99ef11c44eeab3f0cc0d3295e254',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:53:44Z,use_quota=True,user_id='cc1f786d80014de79b97b0f57d1e9d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Creating volume 570e7c9b-4252-4cc9-9f20-f77f129a0fec {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:53:54 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:54 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec 1073741824 Jul 24 15:53:54 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "cinder-quobyte-a3c3a0dc-7b13-47f8-accd-529e10d11048" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d9ff36-28a8-48cf-a095-1edf1cdc73af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa', 'volume_size': 1, 'snapshot_id': 'd995259a-7c08-4427-a626-9ce0d9ab6399'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feed676e-6f3a-4898-a0de-db4d93fedd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-a3c3a0dc-7b13-47f8-accd-529e10d11048" acquired by "delete_volume" :: waited 0.037s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:54 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Volume volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa (f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa): created successfully Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feed676e-6f3a-4898-a0de-db4d93fedd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Flow 'volume_create_manager' (27c19f4a-74f6-4a26-9c34-ffdf2614c4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3eb132-f40c-4927-8e01-3db158504fdb]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a3c3a0dc-7b13-47f8-accd-529e10d11048 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:54 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-cfd5258e-e95d-4fb3-be79-a00d026759f9 tempest-VolumeDependencyTests-954178699 None] Created volume successfully. Jul 24 15:53:54 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a3c3a0dc-7b13-47f8-accd-529e10d11048 Jul 24 15:53:54 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "cinder-d995259a-7c08-4427-a626-9ce0d9ab6399-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-d995259a-7c08-4427-a626-9ce0d9ab6399-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "cinder-quobyte-fa99975e-284f-43f9-b968-8c4cbe2a28f6" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-quobyte-fa99975e-284f-43f9-b968-8c4cbe2a28f6" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "cinder-quobyte-d995259a-7c08-4427-a626-9ce0d9ab6399" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-quobyte-d995259a-7c08-4427-a626-9ce0d9ab6399" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Deleting offline snapshot d995259a-7c08-4427-a626-9ce0d9ab6399 of volume fa99975e-284f-43f9-b968-8c4cbe2a28f6 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] snapshot_file for this snap is: volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf9c211-117a-4b77-b11a-9ca33a9c153b]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:55 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec 1073741824" returned: 0 in 0.581s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:55 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a3c3a0dc-7b13-47f8-accd-529e10d11048" returned: 0 in 0.519s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a3c3a0dc-7b13-47f8-accd-529e10d11048 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:55 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 Jul 24 15:53:55 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:55 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a3c3a0dc-7b13-47f8-accd-529e10d11048 Jul 24 15:53:55 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:55 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec Jul 24 15:53:55 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:55 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399" returned: 0 in 0.452s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:53:55 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:55 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec" returned: 0 in 0.292s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a3c3a0dc-7b13-47f8-accd-529e10d11048" returned: 0 in 0.336s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb44022-55be-4dfb-b7f2-36379372c9c9]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-quobyte-a3c3a0dc-7b13-47f8-accd-529e10d11048" released by "delete_volume" :: held 0.919s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4b33b73-3f36-463a-930d-72dba82b2a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce1907f-6bbd-4ccb-9b30-b8796eccb82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:53:55 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Volume volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec (570e7c9b-4252-4cc9-9f20-f77f129a0fec): created successfully Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce1907f-6bbd-4ccb-9b30-b8796eccb82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Flow 'volume_create_manager' (9968b04b-5dec-4332-a211-e5c67eb52420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:53:55 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-ad3ac0f0-59fd-430a-ae7c-5b2a47284922 tempest-VolumesActionsTest-1968172073 None] Created volume successfully. Jul 24 15:53:55 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 Jul 24 15:53:55 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Created reservations ['307fff28-90e4-414a-a042-8ad72f284107', 'ce2afde0-b312-44bb-87e2-e702416915e0', '0283eba7-c276-4c28-b074-59a7786924af', 'b60991ef-7532-4927-ac15-aa8b2f1b2619'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:55 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:55 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:56 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6" returned: 0 in 0.417s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:56 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 Jul 24 15:53:56 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:56 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.276s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:56 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:56 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Deleted volume successfully. Jul 24 15:53:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-738ab6cd-bb63-4ed6-9792-ccec7fc7a6f4 tempest-VolumesDeleteCascade-1446356427 None] Lock "cinder-a3c3a0dc-7b13-47f8-accd-529e10d11048-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:56 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399" returned: 0 in 0.398s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:56 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399 Jul 24 15:53:56 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:56 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6.d995259a-7c08-4427-a626-9ce0d9ab6399" returned: 0 in 0.247s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-quobyte-d995259a-7c08-4427-a626-9ce0d9ab6399" released by "_delete_snapshot" :: held 1.636s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-quobyte-fa99975e-284f-43f9-b968-8c4cbe2a28f6" released by "delete_snapshot" :: held 1.670s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:56 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Created reservations ['8c8d149b-3437-444b-8b09-7547af9df47b', 'efa34904-44a1-44e2-932b-dd1b90a96e46', '9cee3b49-4d52-4d94-aeb0-3a73dce9b108', '2fb07251-2dff-494a-a5c1-027589db5a57'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:56 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Delete snapshot completed successfully. Jul 24 15:53:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8ff8e84b-c8db-4682-9130-7cf9b7198438 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-d995259a-7c08-4427-a626-9ce0d9ab6399-delete_snapshot" released by "delete_snapshot" :: held 1.862s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Acquiring lock "cinder-570e7c9b-4252-4cc9-9f20-f77f129a0fec-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Lock "cinder-570e7c9b-4252-4cc9-9f20-f77f129a0fec-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "cinder-fa99975e-284f-43f9-b968-8c4cbe2a28f6-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-fa99975e-284f-43f9-b968-8c4cbe2a28f6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Acquiring lock "cinder-quobyte-570e7c9b-4252-4cc9-9f20-f77f129a0fec" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Lock "cinder-quobyte-570e7c9b-4252-4cc9-9f20-f77f129a0fec" acquired by "delete_volume" :: waited 0.032s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "cinder-quobyte-fa99975e-284f-43f9-b968-8c4cbe2a28f6" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:57 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8620bb5b-b9fe-4b38-bff3-ed03b06fac5e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-quobyte-fa99975e-284f-43f9-b968-8c4cbe2a28f6" acquired by "delete_volume" :: waited 0.033s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:57 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e637e15b-cf39-4ff3-a278-5b2d8ebd1b2c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:57 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec Jul 24 15:53:57 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:57 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 Jul 24 15:53:57 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:57 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec" returned: 0 in 0.427s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:57 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec Jul 24 15:53:57 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:57 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6" returned: 0 in 0.553s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:58 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6 Jul 24 15:53:58 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:58 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-570e7c9b-4252-4cc9-9f20-f77f129a0fec" returned: 0 in 0.367s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Lock "cinder-quobyte-570e7c9b-4252-4cc9-9f20-f77f129a0fec" released by "delete_volume" :: held 0.863s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Created reservations ['5edda969-0ab8-44f3-bb1c-ff772383c14d', 'bd620c62-e5fc-4654-bf7b-f275c39387c3', 'c3bc30e9-8144-4df5-a128-9699768d955e', '986c6bc1-518d-413c-8895-cfaf0bef258a'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:58 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fa99975e-284f-43f9-b968-8c4cbe2a28f6" returned: 0 in 0.377s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-quobyte-fa99975e-284f-43f9-b968-8c4cbe2a28f6" released by "delete_volume" :: held 1.049s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:58 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:58 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Created reservations ['77f3619c-aa3f-4168-82ec-7f0cece75dfd', 'ab14577a-8c77-4b83-8ea9-b2abaa623400', '05839252-9cf6-4bb2-8349-07548c19c532', 'c436f235-1706-4093-a5ff-0884e85bc5de'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:58 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:53:58 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:53:58 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.421s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:58 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Deleted volume successfully. Jul 24 15:53:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-035ade01-26fd-44aa-a7ff-834a350e43ad tempest-VolumesActionsTest-1968172073 None] Lock "cinder-570e7c9b-4252-4cc9-9f20-f77f129a0fec-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:59 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Jul 24 15:53:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.353s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:53:59 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:53:59 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Deleted volume successfully. Jul 24 15:53:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-90b301cc-36bf-4931-ac4a-58ab17190319 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-fa99975e-284f-43f9-b968-8c4cbe2a28f6-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:53:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "cinder-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "cinder-quobyte-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:53:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-quobyte-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa" acquired by "delete_volume" :: waited 0.021s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:53:59 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[474c2060-069c-420b-ab32-d318b3c0e3d3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:53:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:53:59 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa Jul 24 15:53:59 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:00 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa" returned: 0 in 0.534s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:00 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa Jul 24 15:54:00 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:00 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa" returned: 0 in 0.371s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-quobyte-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa" released by "delete_volume" :: held 0.971s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:00 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Created reservations ['9544830e-42de-4e2d-980b-26dc17920f3d', 'b78a1e69-f931-49b1-ad1c-d732e6a02cdc', '0b2d53ec-e3d0-4edf-947c-58138c715747', '656e12f8-f2e9-48fa-95ab-ec117929250b'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:54:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:00 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:54:00 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:01 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.334s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:01 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:54:01 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Deleted volume successfully. Jul 24 15:54:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-787a2ed5-f133-45e0-b31a-bfea11e09966 tempest-VolumeDependencyTests-954178699 None] Lock "cinder-f9ef1037-d8fc-48ea-85bb-c9fdd7cd68fa-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Flow 'volume_create_manager' (bdc78153-75e9-434d-96d7-e4865f16bbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfaccca8-f58b-47ab-bbff-77c45bed0927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfaccca8-f58b-47ab-bbff-77c45bed0927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1542632609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237a21ea-becf-4192-8b1c-f23ac87e02ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9159b7b9a462451a9a3b88db8a74ec21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:03Z,use_quota=True,user_id='40971965af354bdfaad558fe7f6dc9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b0d2fd-cbee-4787-b30b-4e8938b54b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b0d2fd-cbee-4787-b30b-4e8938b54b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cde9d47-8547-49c9-8035-72ef5a2126dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cde9d47-8547-49c9-8035-72ef5a2126dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '237a21ea-becf-4192-8b1c-f23ac87e02ff', 'volume_name': 'volume-237a21ea-becf-4192-8b1c-f23ac87e02ff', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b5aa2a-51dc-467a-b1f2-f1eac96e8096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b5aa2a-51dc-467a-b1f2-f1eac96e8096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54bf85d-407d-4771-a5ca-0acc5dd94ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:03 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Volume 237a21ea-becf-4192-8b1c-f23ac87e02ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-237a21ea-becf-4192-8b1c-f23ac87e02ff', 'volume_size': 1} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1542632609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237a21ea-becf-4192-8b1c-f23ac87e02ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9159b7b9a462451a9a3b88db8a74ec21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:03Z,use_quota=True,user_id='40971965af354bdfaad558fe7f6dc9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Creating volume 237a21ea-becf-4192-8b1c-f23ac87e02ff {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:03 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:54:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-237a21ea-becf-4192-8b1c-f23ac87e02ff 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:03 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-237a21ea-becf-4192-8b1c-f23ac87e02ff 1073741824 Jul 24 15:54:03 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:04 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-237a21ea-becf-4192-8b1c-f23ac87e02ff 1073741824" returned: 0 in 0.639s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-237a21ea-becf-4192-8b1c-f23ac87e02ff {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:04 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-237a21ea-becf-4192-8b1c-f23ac87e02ff Jul 24 15:54:04 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:04 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-237a21ea-becf-4192-8b1c-f23ac87e02ff" returned: 0 in 0.362s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54bf85d-407d-4771-a5ca-0acc5dd94ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-237a21ea-becf-4192-8b1c-f23ac87e02ff', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df196a70-0520-48dd-acd7-2f013c58f34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:04 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Volume volume-237a21ea-becf-4192-8b1c-f23ac87e02ff (237a21ea-becf-4192-8b1c-f23ac87e02ff): created successfully Jul 24 15:54:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df196a70-0520-48dd-acd7-2f013c58f34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Flow 'volume_create_manager' (bdc78153-75e9-434d-96d7-e4865f16bbce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:04 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-6952e335-29af-41c5-a413-2799d8868d82 tempest-VolumesTransfersV357Test-1227838621 None] Created volume successfully. Jul 24 15:54:06 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-0bd76afe-c1db-4bb3-a018-7e42b1a1bac7 tempest-VolumesTransfersV357Test-601615053 None] Transfer volume completed successfully. Jul 24 15:54:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Acquiring lock "cinder-237a21ea-becf-4192-8b1c-f23ac87e02ff-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Lock "cinder-237a21ea-becf-4192-8b1c-f23ac87e02ff-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Acquiring lock "cinder-quobyte-237a21ea-becf-4192-8b1c-f23ac87e02ff" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Lock "cinder-quobyte-237a21ea-becf-4192-8b1c-f23ac87e02ff" acquired by "delete_volume" :: waited 0.021s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:07 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eba792f-52f2-44c5-a80a-48b955909dcf]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-237a21ea-becf-4192-8b1c-f23ac87e02ff {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:07 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-237a21ea-becf-4192-8b1c-f23ac87e02ff Jul 24 15:54:07 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:07 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-237a21ea-becf-4192-8b1c-f23ac87e02ff" returned: 0 in 0.430s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-237a21ea-becf-4192-8b1c-f23ac87e02ff {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:07 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-237a21ea-becf-4192-8b1c-f23ac87e02ff Jul 24 15:54:07 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:07 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-237a21ea-becf-4192-8b1c-f23ac87e02ff" returned: 0 in 0.335s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Lock "cinder-quobyte-237a21ea-becf-4192-8b1c-f23ac87e02ff" released by "delete_volume" :: held 0.833s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:07 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Created reservations ['7c17b550-aa1b-4dba-bf32-0edd2a75ae12', '483caed2-cb44-4d3a-894d-2b2342f95628', '4e0211d8-0330-4792-8cf1-acffcae780bf', 'a11cbd84-1a25-4608-b114-feee22be5cb2'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:54:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:08 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:54:08 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:08 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.551s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:08 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:54:08 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Deleted volume successfully. Jul 24 15:54:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cb66462-c512-48a5-a5fc-11f407bc0259 tempest-VolumesTransfersV357Test-710015421 None] Lock "cinder-237a21ea-becf-4192-8b1c-f23ac87e02ff-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Flow 'volume_create_manager' (aa8d3d4f-b25b-46b3-82f8-6357a195cef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afaff5d-7d2f-43d7-89f4-b67ae1301687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1afaff5d-7d2f-43d7-89f4-b67ae1301687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fc1a44-6852-44c4-94f6-f8f93123dd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bc21c87012434d919883b086706c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:09Z,use_quota=True,user_id='0d493c2acdff4f479fc49e94fb7c43ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a77239e-39f9-46cd-a505-f56d1531af1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a77239e-39f9-46cd-a505-f56d1531af1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d932e580-cf45-4633-b27d-db2c55c1b104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.image.glance [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Creating Keystone auth plugin from conf {{(pid=88350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Flow 'volume_create_manager' (2589dac2-f30f-4054-833f-e8bcc0d3422b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8dd743-f9f6-4ddb-8d8b-2961b29e5c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8dd743-f9f6-4ddb-8d8b-2961b29e5c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-508708572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879ea73f-a08c-4081-b064-1e7899080c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9159b7b9a462451a9a3b88db8a74ec21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:09Z,use_quota=True,user_id='40971965af354bdfaad558fe7f6dc9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2dc78e-b944-439c-8b8b-49e77e8940c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa2dc78e-b944-439c-8b8b-49e77e8940c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a0e20b-e44f-45a4-a8cb-a54a349e6965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a0e20b-e44f-45a4-a8cb-a54a349e6965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '879ea73f-a08c-4081-b064-1e7899080c5b', 'volume_name': 'volume-879ea73f-a08c-4081-b064-1e7899080c5b', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6166618-ac03-432a-96f5-603faa779b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6166618-ac03-432a-96f5-603faa779b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efaf9d31-2224-43cb-b1ca-1884b8f6770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:09 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Volume 879ea73f-a08c-4081-b064-1e7899080c5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-879ea73f-a08c-4081-b064-1e7899080c5b', 'volume_size': 1} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-508708572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879ea73f-a08c-4081-b064-1e7899080c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9159b7b9a462451a9a3b88db8a74ec21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:09Z,use_quota=True,user_id='40971965af354bdfaad558fe7f6dc9f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Creating volume 879ea73f-a08c-4081-b064-1e7899080c5b {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:09 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-879ea73f-a08c-4081-b064-1e7899080c5b 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:09 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-879ea73f-a08c-4081-b064-1e7899080c5b 1073741824 Jul 24 15:54:09 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d932e580-cf45-4633-b27d-db2c55c1b104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c4fc1a44-6852-44c4-94f6-f8f93123dd47', 'volume_name': 'volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47', 'volume_size': 1, 'image_id': '560219d9-1052-4bcd-9a73-7d1c2e98ef4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/560219d9-1052-4bcd-9a73-7d1c2e98ef4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7051bb2486c577ed7e7d5a9a0c050e06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '02bc21c87012434d919883b086706c8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f38b17872b647fdf9d863ace0121a0c7239c95de19e05e9fe7eefa06fe582576694abad2246400e070ff9082694763adec760bd6042a21aa8cfcd47420fb5d44', 'id': '560219d9-1052-4bcd-9a73-7d1c2e98ef4c', 'created_at': datetime.datetime(2026, 7, 24, 13, 54, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 54, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/560219d9-1052-4bcd-9a73-7d1c2e98ef4c/file', 'properties': {}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3882263e-e63a-4fd1-8951-9eea2405192e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3882263e-e63a-4fd1-8951-9eea2405192e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471783af-6e1b-4d6d-89a4-c725688ad883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:09 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Volume c4fc1a44-6852-44c4-94f6-f8f93123dd47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47', 'volume_size': 1, 'image_id': '560219d9-1052-4bcd-9a73-7d1c2e98ef4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/560219d9-1052-4bcd-9a73-7d1c2e98ef4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7051bb2486c577ed7e7d5a9a0c050e06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '02bc21c87012434d919883b086706c8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f38b17872b647fdf9d863ace0121a0c7239c95de19e05e9fe7eefa06fe582576694abad2246400e070ff9082694763adec760bd6042a21aa8cfcd47420fb5d44', 'id': '560219d9-1052-4bcd-9a73-7d1c2e98ef4c', 'created_at': datetime.datetime(2026, 7, 24, 13, 54, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 54, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/560219d9-1052-4bcd-9a73-7d1c2e98ef4c/file', 'properties': {}}, 'image_service': } Jul 24 15:54:09 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Trying to clone c4fc1a44-6852-44c4-94f6-f8f93123dd47 from image 560219d9-1052-4bcd-9a73-7d1c2e98ef4c at location (None, [{'url': 'file:///opt/stack/data/glance/images/560219d9-1052-4bcd-9a73-7d1c2e98ef4c', 'metadata': {}}]). {{(pid=88350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:54:10 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:54:10 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Image download 0.00 MB at 0.00 MB/s Jul 24 15:54:10 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff93927-590a-4d67-b0d9-f2dfc51f858b]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:10 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-879ea73f-a08c-4081-b064-1e7899080c5b 1073741824" returned: 0 in 0.717s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-879ea73f-a08c-4081-b064-1e7899080c5b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:10 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-879ea73f-a08c-4081-b064-1e7899080c5b Jul 24 15:54:10 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:10 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD Jul 24 15:54:10 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:10 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-879ea73f-a08c-4081-b064-1e7899080c5b" returned: 0 in 0.396s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:10 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD" returned: 0 in 0.481s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efaf9d31-2224-43cb-b1ca-1884b8f6770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-879ea73f-a08c-4081-b064-1e7899080c5b', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72846b3a-97a3-4d83-9e85-c5a5d9537565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:10 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Volume volume-879ea73f-a08c-4081-b064-1e7899080c5b (879ea73f-a08c-4081-b064-1e7899080c5b): created successfully Jul 24 15:54:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72846b3a-97a3-4d83-9e85-c5a5d9537565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Flow 'volume_create_manager' (2589dac2-f30f-4054-833f-e8bcc0d3422b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:10 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a774d9db-89d3-4ef9-bec9-e5d7d6fa48ea tempest-VolumesTransfersV357Test-1227838621 None] Created volume successfully. Jul 24 15:54:10 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD Jul 24 15:54:10 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:11 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD" returned: 1 in 0.392s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:54:11 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Temporary image 560219d9-1052-4bcd-9a73-7d1c2e98ef4c is fetched for user 0d493c2acdff4f479fc49e94fb7c43ed. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:54:11 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0346c52-c14a-4e4b-9418-dff8566e51d0]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:11 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD Jul 24 15:54:11 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:11 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD" returned: 0 in 0.453s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Acquiring lock "cinder-879ea73f-a08c-4081-b064-1e7899080c5b-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Lock "cinder-879ea73f-a08c-4081-b064-1e7899080c5b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:11 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD Jul 24 15:54:11 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Acquiring lock "cinder-quobyte-879ea73f-a08c-4081-b064-1e7899080c5b" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Lock "cinder-quobyte-879ea73f-a08c-4081-b064-1e7899080c5b" acquired by "delete_volume" :: waited 0.028s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:11 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b510e3d-3bb7-4906-a353-ce5f043562a3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-879ea73f-a08c-4081-b064-1e7899080c5b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:12 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD" returned: 1 in 0.434s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4fc1a44-6852-44c4-94f6-f8f93123dd47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02bc21c87012434d919883b086706c8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:09Z,use_quota=True,user_id='0d493c2acdff4f479fc49e94fb7c43ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Creating volume c4fc1a44-6852-44c4-94f6-f8f93123dd47 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:12 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-879ea73f-a08c-4081-b064-1e7899080c5b Jul 24 15:54:12 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:12 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:12 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 1073741824 Jul 24 15:54:12 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:12 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-879ea73f-a08c-4081-b064-1e7899080c5b" returned: 0 in 0.519s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-879ea73f-a08c-4081-b064-1e7899080c5b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:12 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-879ea73f-a08c-4081-b064-1e7899080c5b Jul 24 15:54:12 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:12 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 1073741824" returned: 0 in 0.684s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:12 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-879ea73f-a08c-4081-b064-1e7899080c5b" returned: 0 in 0.388s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Lock "cinder-quobyte-879ea73f-a08c-4081-b064-1e7899080c5b" released by "delete_volume" :: held 0.984s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:12 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 Jul 24 15:54:12 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:12 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Created reservations ['0108d2b7-7393-48ca-ac49-0785426ad550', '259caa9c-c6f9-49e7-ba8d-eaf5f84b2bb3', '8677cc69-0651-4b33-be4a-40fbd17121a2', '01dc16e6-afbe-4743-9a49-ddce467a538b'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:13 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:54:13 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:13 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47" returned: 0 in 0.329s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Attempting download of 560219d9-1052-4bcd-9a73-7d1c2e98ef4c ((None, [{'url': 'file:///opt/stack/data/glance/images/560219d9-1052-4bcd-9a73-7d1c2e98ef4c', 'metadata': {}}])) to volume c4fc1a44-6852-44c4-94f6-f8f93123dd47. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5957a051-661f-40ed-9723-9b3e90db98cc]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_pzysble4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:13 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.415s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:54:13 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_pzysble4 Jul 24 15:54:13 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:13 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Deleted volume successfully. Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-fe708b73-d11d-4e80-ae1a-dafa92865dd5 tempest-VolumesTransfersV357Test-710015421 None] Lock "cinder-879ea73f-a08c-4081-b064-1e7899080c5b-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:13 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_pzysble4" returned: 0 in 0.446s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_pzysble4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:13 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_pzysble4 Jul 24 15:54:13 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:14 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_pzysble4" returned: 1 in 0.430s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_pzysble4' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:54:14 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f051e31b-08a1-45ee-8deb-e9f0849a5191]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:14 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD Jul 24 15:54:14 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:14 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD" returned: 0 in 0.529s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:14 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD Jul 24 15:54:14 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:15 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD" returned: 1 in 0.492s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:54:15 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] 560219d9-1052-4bcd-9a73-7d1c2e98ef4c was raw, converting to qcow2 {{(pid=88350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:54:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:15 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 Jul 24 15:54:15 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:15 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-9962a782-aa08-421f-b6dc-569b6a2d37bb req-1edbe120-a6b6-4901-9462-91b6370a81d2 tempest-TestMinimumBasicScenario-18470097 None] Terminate volume connection completed successfully. Jul 24 15:54:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-9962a782-aa08-421f-b6dc-569b6a2d37bb req-1edbe120-a6b6-4901-9462-91b6370a81d2 tempest-TestMinimumBasicScenario-18470097 None] Deleting attachment d80fad20-0978-4626-9caf-10ec42a1922c. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:54:15 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47" returned: 0 in 0.649s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:15 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_560219d9-1052-4bcd-9a73-7d1c2e98ef4c_wbciw592devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:54:15 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 15:54:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:15 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 1G Jul 24 15:54:15 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:15 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Acquiring lock "cinder-fffc4696-a893-431e-bbf8-416239b04bc5-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Lock "cinder-fffc4696-a893-431e-bbf8-416239b04bc5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Acquiring lock "cinder-quobyte-fffc4696-a893-431e-bbf8-416239b04bc5" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Lock "cinder-quobyte-fffc4696-a893-431e-bbf8-416239b04bc5" acquired by "delete_volume" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec2a160-ba9d-47ac-843f-62078beae7e9]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fffc4696-a893-431e-bbf8-416239b04bc5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:16 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fffc4696-a893-431e-bbf8-416239b04bc5 Jul 24 15:54:16 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:16 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 1G" returned: 0 in 0.565s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Downloaded image 560219d9-1052-4bcd-9a73-7d1c2e98ef4c ((None, [{'url': 'file:///opt/stack/data/glance/images/560219d9-1052-4bcd-9a73-7d1c2e98ef4c', 'metadata': {}}])) to volume c4fc1a44-6852-44c4-94f6-f8f93123dd47 successfully. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Temporary image 560219d9-1052-4bcd-9a73-7d1c2e98ef4c for user 0d493c2acdff4f479fc49e94fb7c43ed is deleted. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Marking volume c4fc1a44-6852-44c4-94f6-f8f93123dd47 as bootable. {{(pid=88350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Copying metadata from image 560219d9-1052-4bcd-9a73-7d1c2e98ef4c to c4fc1a44-6852-44c4-94f6-f8f93123dd47. {{(pid=88350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Creating volume glance metadata for volume c4fc1a44-6852-44c4-94f6-f8f93123dd47 backed by image 560219d9-1052-4bcd-9a73-7d1c2e98ef4c with: {'image_id': '560219d9-1052-4bcd-9a73-7d1c2e98ef4c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7051bb2486c577ed7e7d5a9a0c050e06', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471783af-6e1b-4d6d-89a4-c725688ad883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47', 'volume_size': 1, 'image_id': '560219d9-1052-4bcd-9a73-7d1c2e98ef4c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/560219d9-1052-4bcd-9a73-7d1c2e98ef4c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7051bb2486c577ed7e7d5a9a0c050e06', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '02bc21c87012434d919883b086706c8e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f38b17872b647fdf9d863ace0121a0c7239c95de19e05e9fe7eefa06fe582576694abad2246400e070ff9082694763adec760bd6042a21aa8cfcd47420fb5d44', 'id': '560219d9-1052-4bcd-9a73-7d1c2e98ef4c', 'created_at': datetime.datetime(2026, 7, 24, 13, 54, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 54, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/560219d9-1052-4bcd-9a73-7d1c2e98ef4c/file', 'properties': {}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d05e82c-2a4f-402a-9899-a00451a98027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:16 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Volume volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 (c4fc1a44-6852-44c4-94f6-f8f93123dd47): created successfully Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d05e82c-2a4f-402a-9899-a00451a98027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Flow 'volume_create_manager' (aa8d3d4f-b25b-46b3-82f8-6357a195cef2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:16 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fffc4696-a893-431e-bbf8-416239b04bc5" returned: 0 in 0.511s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fffc4696-a893-431e-bbf8-416239b04bc5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:16 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-82816de1-b10a-42f4-a935-ec2acd30bcc1 tempest-VolumeImageDependencyTests-2755887 None] Created volume successfully. Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:54:16 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fffc4696-a893-431e-bbf8-416239b04bc5 Jul 24 15:54:16 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Flow 'volume_create_manager' (62a23b64-5276-49b8-9f21-b57c1689d1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d148013-a73f-468f-aae3-18515d3cb999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d148013-a73f-468f-aae3-18515d3cb999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1003454750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fdd67c-9ee1-4ecd-85a0-e6626ef2e476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5444366463be4a75b9da39a97b7031a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:17Z,use_quota=True,user_id='acd6ae2ffba74fc98fca8940e90ba676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42e881a-75fd-4b7d-ba55-5e0824f22dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d42e881a-75fd-4b7d-ba55-5e0824f22dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1950c4-0cd8-4d1e-a024-9743e93e3c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1950c4-0cd8-4d1e-a024-9743e93e3c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07fdd67c-9ee1-4ecd-85a0-e6626ef2e476', 'volume_name': 'volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4487653-ddcc-4650-9a15-233b70956b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4487653-ddcc-4650-9a15-233b70956b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7e429e-a8a3-4133-9ec4-3c365fd40f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:16 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Volume 07fdd67c-9ee1-4ecd-85a0-e6626ef2e476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476', 'volume_size': 1} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1003454750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07fdd67c-9ee1-4ecd-85a0-e6626ef2e476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5444366463be4a75b9da39a97b7031a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:17Z,use_quota=True,user_id='acd6ae2ffba74fc98fca8940e90ba676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Creating volume 07fdd67c-9ee1-4ecd-85a0-e6626ef2e476 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:16 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:54:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:16 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476 1073741824 Jul 24 15:54:16 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:17 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fffc4696-a893-431e-bbf8-416239b04bc5" returned: 0 in 0.321s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Lock "cinder-quobyte-fffc4696-a893-431e-bbf8-416239b04bc5" released by "delete_volume" :: held 0.905s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Created reservations ['bdf12427-4062-4ac8-a1b2-c388752d3a4d', '68f95ce6-12d7-40f8-a324-7c5e448f4577', '31098721-68dd-4dab-8972-482d78b4a13d', '7bd6320e-37c8-44f3-80b9-ebfcb1939d6c'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:17 devstack sudo[102030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:54:17 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:17 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476 1073741824" returned: 0 in 0.561s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:17 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476 Jul 24 15:54:17 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:17 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.317s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:54:17 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Deleted volume successfully. Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0becd05d-9442-4e6f-abd6-f40c3228e5e9 tempest-TestMinimumBasicScenario-18470097 None] Lock "cinder-fffc4696-a893-431e-bbf8-416239b04bc5-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:17 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476" returned: 0 in 0.307s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7e429e-a8a3-4133-9ec4-3c365fd40f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880c4510-b1e1-47b9-bbe4-c7e6712a9cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:17 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Volume volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476 (07fdd67c-9ee1-4ecd-85a0-e6626ef2e476): created successfully Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880c4510-b1e1-47b9-bbe4-c7e6712a9cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Flow 'volume_create_manager' (62a23b64-5276-49b8-9f21-b57c1689d1cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:17 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1a5a6082-08bb-4ca1-be3d-77440d01feb2 tempest-VolumesListAdminTestJSON-2078589268 None] Created volume successfully. Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Acquiring lock "cinder-c4fc1a44-6852-44c4-94f6-f8f93123dd47-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Lock "cinder-c4fc1a44-6852-44c4-94f6-f8f93123dd47-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Acquiring lock "cinder-quobyte-c4fc1a44-6852-44c4-94f6-f8f93123dd47" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Lock "cinder-quobyte-c4fc1a44-6852-44c4-94f6-f8f93123dd47" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:18 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8dceba-2f7b-4946-9450-97e8e4088c78]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:18 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 Jul 24 15:54:18 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:18 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47" returned: 0 in 0.493s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:18 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47 Jul 24 15:54:18 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:18 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4fc1a44-6852-44c4-94f6-f8f93123dd47" returned: 0 in 0.369s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Lock "cinder-quobyte-c4fc1a44-6852-44c4-94f6-f8f93123dd47" released by "delete_volume" :: held 0.925s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Created reservations ['d79a2ca7-281b-4741-9592-9d4d5e78eedd', '53f04e32-f02e-4229-a5d9-199fa6b3a3f1', 'd94810d7-ed26-4af6-b92b-ceb9bc3679fe', 'b3ceabb7-a07e-4894-bb01-873e24b6b1ba'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:19 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:54:19 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:19 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Flow 'volume_create_manager' (0d06241d-70dd-4327-9a5c-7a7a64d9f63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e30278-a8c6-4e95-ac92-750aa4e3a205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.470s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:54:19 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Deleted volume successfully. Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0e30278-a8c6-4e95-ac92-750aa4e3a205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-446244109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc89fad-1efd-4405-8f57-25b29da571bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5444366463be4a75b9da39a97b7031a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:20Z,use_quota=True,user_id='acd6ae2ffba74fc98fca8940e90ba676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5ad705-9678-4e4b-90cc-8eb7cfe8e6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b5ad705-9678-4e4b-90cc-8eb7cfe8e6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd74fb50-d451-412a-ad97-5662d70de2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd74fb50-d451-412a-ad97-5662d70de2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fc89fad-1efd-4405-8f57-25b29da571bb', 'volume_name': 'volume-8fc89fad-1efd-4405-8f57-25b29da571bb', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d4f7b8-c246-412a-8ab3-5fad6780b10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d4f7b8-c246-412a-8ab3-5fad6780b10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4a40c8-103a-4f5d-beeb-a32ad25068f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:19 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Volume 8fc89fad-1efd-4405-8f57-25b29da571bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fc89fad-1efd-4405-8f57-25b29da571bb', 'volume_size': 1} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-446244109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc89fad-1efd-4405-8f57-25b29da571bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5444366463be4a75b9da39a97b7031a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:20Z,use_quota=True,user_id='acd6ae2ffba74fc98fca8940e90ba676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Creating volume 8fc89fad-1efd-4405-8f57-25b29da571bb {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:19 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8fc89fad-1efd-4405-8f57-25b29da571bb 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:19 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8fc89fad-1efd-4405-8f57-25b29da571bb 1073741824 Jul 24 15:54:19 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d0c1cd15-1de7-4d14-8a11-03966e0e4aca tempest-VolumeImageDependencyTests-2755887 None] Lock "cinder-c4fc1a44-6852-44c4-94f6-f8f93123dd47-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:20 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8fc89fad-1efd-4405-8f57-25b29da571bb 1073741824" returned: 0 in 0.769s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8fc89fad-1efd-4405-8f57-25b29da571bb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:20 devstack sudo[102082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8fc89fad-1efd-4405-8f57-25b29da571bb Jul 24 15:54:20 devstack sudo[102082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:20 devstack sudo[102082]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8fc89fad-1efd-4405-8f57-25b29da571bb" returned: 0 in 0.299s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad4a40c8-103a-4f5d-beeb-a32ad25068f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fc89fad-1efd-4405-8f57-25b29da571bb', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e831183d-de00-4998-a2b9-cb18b53a41dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:20 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Volume volume-8fc89fad-1efd-4405-8f57-25b29da571bb (8fc89fad-1efd-4405-8f57-25b29da571bb): created successfully Jul 24 15:54:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e831183d-de00-4998-a2b9-cb18b53a41dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Flow 'volume_create_manager' (0d06241d-70dd-4327-9a5c-7a7a64d9f63d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:21 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c7d6e7b8-fa1a-490a-98fc-b51f90ee79e6 tempest-VolumesListAdminTestJSON-2078589268 None] Created volume successfully. Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Flow 'volume_create_manager' (726fc6ef-a544-450f-81bd-0c11a23177c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe0721f-8dd5-4401-b697-5d02020e97c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe0721f-8dd5-4401-b697-5d02020e97c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1697572535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a54f5a-23fa-47e1-b515-8ef3edfd0a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5444366463be4a75b9da39a97b7031a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:23Z,use_quota=True,user_id='acd6ae2ffba74fc98fca8940e90ba676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d72c96-c2e6-4c3a-b251-ab0d2c14f862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d72c96-c2e6-4c3a-b251-ab0d2c14f862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30685273-67ac-41e9-a848-76132a972b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30685273-67ac-41e9-a848-76132a972b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a54f5a-23fa-47e1-b515-8ef3edfd0a2d', 'volume_name': 'volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526aeecf-e302-4454-b8fe-ee6a85bd228e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (526aeecf-e302-4454-b8fe-ee6a85bd228e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424aa918-bda9-441b-be44-23ea42d1ac8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:22 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Volume 63a54f5a-23fa-47e1-b515-8ef3edfd0a2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d', 'volume_size': 1} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1697572535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a54f5a-23fa-47e1-b515-8ef3edfd0a2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5444366463be4a75b9da39a97b7031a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:23Z,use_quota=True,user_id='acd6ae2ffba74fc98fca8940e90ba676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Creating volume 63a54f5a-23fa-47e1-b515-8ef3edfd0a2d {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:22 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:54:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:22 devstack sudo[102085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d 1073741824 Jul 24 15:54:22 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:23 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d 1073741824" returned: 0 in 0.635s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Flow 'volume_create_manager' (864c0491-0f92-4c71-990d-4461d394109d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b72998-3b99-4f49-a2eb-d0f44dcc2847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b72998-3b99-4f49-a2eb-d0f44dcc2847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-482397468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed364a6f-c686-4b2c-9b07-365e02c0fc25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac63c534a6e843a3b5627f417617a8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:23Z,use_quota=True,user_id='100877f6674a4403b74297dc87feb653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f1db86-a33d-46fc-a602-09ca9dde4d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f1db86-a33d-46fc-a602-09ca9dde4d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3879172-eae6-456d-b0b5-eaa014a016f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.image.glance [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Creating Keystone auth plugin from conf {{(pid=88350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:23 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d Jul 24 15:54:23 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:23 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d" returned: 0 in 0.292s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424aa918-bda9-441b-be44-23ea42d1ac8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db093c5b-9d88-4e01-b273-d4158f444a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3879172-eae6-456d-b0b5-eaa014a016f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ed364a6f-c686-4b2c-9b07-365e02c0fc25', 'volume_name': 'volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25', 'volume_size': 1, 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'df66204cc96f42be98c9c3c0564f8276', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'created_at': datetime.datetime(2026, 7, 24, 13, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625a53f7-4191-45b8-9e6f-a859cf747ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625a53f7-4191-45b8-9e6f-a859cf747ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4417b960-c521-47a4-863b-2b522e4c79fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:23 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Volume ed364a6f-c686-4b2c-9b07-365e02c0fc25: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25', 'volume_size': 1, 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'df66204cc96f42be98c9c3c0564f8276', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'created_at': datetime.datetime(2026, 7, 24, 13, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Trying to clone ed364a6f-c686-4b2c-9b07-365e02c0fc25 from image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]). {{(pid=88350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:54:23 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Volume volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d (63a54f5a-23fa-47e1-b515-8ef3edfd0a2d): created successfully Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db093c5b-9d88-4e01-b273-d4158f444a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Flow 'volume_create_manager' (726fc6ef-a544-450f-81bd-0c11a23177c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:23 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e352db36-00c6-4a97-82af-9b5cfec187d1 tempest-VolumesListAdminTestJSON-2078589268 None] Created volume successfully. Jul 24 15:54:24 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_g4zh21aedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:54:24 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Image download 20.69 MB at 20.69 MB/s Jul 24 15:54:24 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab8d800-6193-44ff-be21-ab7b7f128fc4]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_g4zh21aedevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:24 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_g4zh21aedevstack@QuobyteHD Jul 24 15:54:24 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:24 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_g4zh21aedevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:24 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Temporary image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 is fetched for user 100877f6674a4403b74297dc87feb653. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:54:24 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7b0f3b-6c87-410c-a811-cab2a12b7c5e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_g4zh21aedevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:24 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_g4zh21aedevstack@QuobyteHD Jul 24 15:54:24 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:25 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_g4zh21aedevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-482397468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed364a6f-c686-4b2c-9b07-365e02c0fc25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac63c534a6e843a3b5627f417617a8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:23Z,use_quota=True,user_id='100877f6674a4403b74297dc87feb653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Creating volume ed364a6f-c686-4b2c-9b07-365e02c0fc25 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:25 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:25 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 1073741824 Jul 24 15:54:25 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Flow 'volume_create_manager' (d2418c09-6c3c-4208-9b4b-2b51436ab0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7143d3bc-e517-4643-a62f-62960a6eb839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7143d3bc-e517-4643-a62f-62960a6eb839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b49f077-e965-4221-993a-120c2972ab9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c9f13c47254d66854edf020160fa6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:25Z,use_quota=True,user_id='4f2a74129a8f4861ba1e6d794d4308b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8661cbe-ded2-4220-a137-e3294197d244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8661cbe-ded2-4220-a137-e3294197d244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3579a3b5-6bcf-41a8-b85d-aac46da23c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3579a3b5-6bcf-41a8-b85d-aac46da23c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b49f077-e965-4221-993a-120c2972ab9c', 'volume_name': 'volume-8b49f077-e965-4221-993a-120c2972ab9c', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c105ccc-7fc0-447b-a550-350389beb50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c105ccc-7fc0-447b-a550-350389beb50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c5e9d7-82f5-46ab-b9df-c370916c4fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:25 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Volume 8b49f077-e965-4221-993a-120c2972ab9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b49f077-e965-4221-993a-120c2972ab9c', 'volume_size': 1} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:25 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 1073741824" returned: 0 in 0.552s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:25 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 Jul 24 15:54:25 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:25 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25" returned: 0 in 0.271s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.418s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b49f077-e965-4221-993a-120c2972ab9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c9f13c47254d66854edf020160fa6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:25Z,use_quota=True,user_id='4f2a74129a8f4861ba1e6d794d4308b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Creating volume 8b49f077-e965-4221-993a-120c2972ab9c {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:25 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:54:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b49f077-e965-4221-993a-120c2972ab9c 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:26 devstack sudo[102117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b49f077-e965-4221-993a-120c2972ab9c 1073741824 Jul 24 15:54:26 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Attempting download of 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}])) to volume ed364a6f-c686-4b2c-9b07-365e02c0fc25. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c561ac00-633d-4403-a008-6249e5a8735b]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_8kkzbnrl {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:26 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_8kkzbnrl Jul 24 15:54:26 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:26 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_8kkzbnrl" returned: 0 in 0.381s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_8kkzbnrl {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:26 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b49f077-e965-4221-993a-120c2972ab9c 1073741824" returned: 0 in 0.535s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b49f077-e965-4221-993a-120c2972ab9c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:26 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b49f077-e965-4221-993a-120c2972ab9c Jul 24 15:54:26 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:26 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_8kkzbnrl Jul 24 15:54:26 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:26 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b49f077-e965-4221-993a-120c2972ab9c" returned: 0 in 0.290s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:26 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02c5e9d7-82f5-46ab-b9df-c370916c4fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b49f077-e965-4221-993a-120c2972ab9c', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d237fe-42a1-4401-9cf2-b664c533f611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_8kkzbnrl" returned: 1 in 0.411s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_8kkzbnrl' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d38eb85-ab32-4c7c-ac42-fdc249bdc3eb]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_g4zh21aedevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:26 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Volume volume-8b49f077-e965-4221-993a-120c2972ab9c (8b49f077-e965-4221-993a-120c2972ab9c): created successfully Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d237fe-42a1-4401-9cf2-b664c533f611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Flow 'volume_create_manager' (d2418c09-6c3c-4208-9b4b-2b51436ab0a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:26 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-04236c09-66f7-4ef4-b5ea-11e11317401f tempest-VolumesListAdminTestJSON-888723133 None] Created volume successfully. Jul 24 15:54:27 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_g4zh21aedevstack@QuobyteHD Jul 24 15:54:27 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:27 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_g4zh21aedevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:27 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 was qcow2, converting to qcow2 {{(pid=88350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:54:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_g4zh21aedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:27 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_g4zh21aedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 Jul 24 15:54:27 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Acquiring lock "cinder-8b49f077-e965-4221-993a-120c2972ab9c-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Lock "cinder-8b49f077-e965-4221-993a-120c2972ab9c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Acquiring lock "cinder-quobyte-8b49f077-e965-4221-993a-120c2972ab9c" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Lock "cinder-quobyte-8b49f077-e965-4221-993a-120c2972ab9c" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:27 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[257ddced-0470-4f3a-88f6-6f4265d5d7f3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b49f077-e965-4221-993a-120c2972ab9c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Acquiring lock "cinder-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "cinder-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Acquiring lock "cinder-quobyte-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:28 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b49f077-e965-4221-993a-120c2972ab9c Jul 24 15:54:28 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "cinder-quobyte-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a7d8dd-d488-4d17-817e-bea5779c8051]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:28 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d Jul 24 15:54:28 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:28 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b49f077-e965-4221-993a-120c2972ab9c" returned: 0 in 0.498s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b49f077-e965-4221-993a-120c2972ab9c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:28 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b49f077-e965-4221-993a-120c2972ab9c Jul 24 15:54:28 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:28 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d" returned: 0 in 0.519s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:28 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d Jul 24 15:54:28 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:28 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b49f077-e965-4221-993a-120c2972ab9c" returned: 0 in 0.394s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Lock "cinder-quobyte-8b49f077-e965-4221-993a-120c2972ab9c" released by "delete_volume" :: held 0.945s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Created reservations ['083942ab-a648-4edc-8da3-9b220c125e65', 'fa04b34b-63cb-439f-adb5-d32d12d469db', 'f23ba460-3694-4aca-b001-cf7837e8abad', '0b97cb55-5af4-4c89-8fcc-7d1846a01dde'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:28 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:54:28 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:29 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d" returned: 0 in 0.420s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "cinder-quobyte-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d" released by "delete_volume" :: held 0.995s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Created reservations ['d6f2bb94-2f3a-464a-bed9-dacc33def950', '63bafeb6-b857-472b-9837-d07b76817045', '3b6586df-bba4-4800-a7f1-c625ff13e25a', 'ff30328d-e1ab-4f2e-bf9a-d979aa91f895'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:29 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:54:29 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:29 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.363s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:54:29 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Deleted volume successfully. Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-541b3abd-4cfa-4a6d-9079-6d4321dda166 tempest-VolumesListAdminTestJSON-888723133 None] Lock "cinder-8b49f077-e965-4221-993a-120c2972ab9c-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:29 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.349s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:54:29 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Deleted volume successfully. Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3972ae66-75b3-4dbc-97ea-ee94601feb12 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "cinder-63a54f5a-23fa-47e1-b515-8ef3edfd0a2d-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:29 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_g4zh21aedevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25" returned: 0 in 2.508s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_g4zh21aedevstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:54:29 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Converted 112.00 MB image at 44.62 MB/s Jul 24 15:54:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:29 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 1G Jul 24 15:54:29 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:30 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 1G" returned: 0 in 0.361s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Downloaded image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}])) to volume ed364a6f-c686-4b2c-9b07-365e02c0fc25 successfully. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Temporary image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 for user 100877f6674a4403b74297dc87feb653 is deleted. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Marking volume ed364a6f-c686-4b2c-9b07-365e02c0fc25 as bootable. {{(pid=88350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Copying metadata from image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 to ed364a6f-c686-4b2c-9b07-365e02c0fc25. {{(pid=88350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Creating volume glance metadata for volume ed364a6f-c686-4b2c-9b07-365e02c0fc25 backed by image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4417b960-c521-47a4-863b-2b522e4c79fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25', 'volume_size': 1, 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'df66204cc96f42be98c9c3c0564f8276', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'created_at': datetime.datetime(2026, 7, 24, 13, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00465739-3e1d-4ab8-a20f-27a86a22727a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:30 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Volume volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 (ed364a6f-c686-4b2c-9b07-365e02c0fc25): created successfully Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00465739-3e1d-4ab8-a20f-27a86a22727a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Flow 'volume_create_manager' (864c0491-0f92-4c71-990d-4461d394109d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:30 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-ba4dad16-e38e-4416-ae23-f9fdcf847255 tempest-VolumesExtendTest-2012521796 None] Created volume successfully. Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Acquiring lock "cinder-8fc89fad-1efd-4405-8f57-25b29da571bb-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "cinder-8fc89fad-1efd-4405-8f57-25b29da571bb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Acquiring lock "cinder-quobyte-8fc89fad-1efd-4405-8f57-25b29da571bb" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "cinder-quobyte-8fc89fad-1efd-4405-8f57-25b29da571bb" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba670be-f185-4809-afae-8cb5cca6a418]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8fc89fad-1efd-4405-8f57-25b29da571bb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:30 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8fc89fad-1efd-4405-8f57-25b29da571bb Jul 24 15:54:30 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:30 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8fc89fad-1efd-4405-8f57-25b29da571bb" returned: 0 in 0.391s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8fc89fad-1efd-4405-8f57-25b29da571bb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:30 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8fc89fad-1efd-4405-8f57-25b29da571bb Jul 24 15:54:30 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4ad5f16e-7f10-4a0a-842f-6f42fb89546c tempest-VolumesExtendTest-2012521796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4ad5f16e-7f10-4a0a-842f-6f42fb89546c tempest-VolumesExtendTest-2012521796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9420b30-2d5f-4a43-b121-d5e855a09026]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4ad5f16e-7f10-4a0a-842f-6f42fb89546c tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:31 devstack sudo[102188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 Jul 24 15:54:31 devstack sudo[102188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:31 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8fc89fad-1efd-4405-8f57-25b29da571bb" returned: 0 in 0.325s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "cinder-quobyte-8fc89fad-1efd-4405-8f57-25b29da571bb" released by "delete_volume" :: held 0.763s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Created reservations ['59249913-4b19-4223-b603-975db47eb4c1', 'fd3668b0-31b2-49f9-9acc-d303e8063f5e', '81dd2e79-bfe2-462a-8dd1-5a21c3cbe8b7', '59f3becb-aeca-497c-848b-d4f27809752f'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:31 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:54:31 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:31 devstack sudo[102188]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4ad5f16e-7f10-4a0a-842f-6f42fb89546c tempest-VolumesExtendTest-2012521796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25" returned: 0 in 0.462s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4ad5f16e-7f10-4a0a-842f-6f42fb89546c tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 2G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4ad5f16e-7f10-4a0a-842f-6f42fb89546c tempest-VolumesExtendTest-2012521796 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 2G" returned: 0 in 0.115s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4ad5f16e-7f10-4a0a-842f-6f42fb89546c tempest-VolumesExtendTest-2012521796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.612s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Acquiring lock "cinder-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "cinder-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:31 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-4ad5f16e-7f10-4a0a-842f-6f42fb89546c tempest-VolumesExtendTest-2012521796 None] Extend volume completed successfully. Jul 24 15:54:31 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Acquiring lock "cinder-quobyte-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.329s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:54:31 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Deleted volume successfully. Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "cinder-quobyte-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476" acquired by "delete_volume" :: waited 0.037s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2541f0cf-5eaa-4722-9ca3-eae845b71c75 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "cinder-8fc89fad-1efd-4405-8f57-25b29da571bb-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7245e7-8a6c-493c-8447-c5c64c791f45]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:31 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476 Jul 24 15:54:31 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:32 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476" returned: 0 in 0.398s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:32 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476 Jul 24 15:54:32 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Acquiring lock "cinder-ed364a6f-c686-4b2c-9b07-365e02c0fc25-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Lock "cinder-ed364a6f-c686-4b2c-9b07-365e02c0fc25-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Acquiring lock "cinder-quobyte-ed364a6f-c686-4b2c-9b07-365e02c0fc25" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Lock "cinder-quobyte-ed364a6f-c686-4b2c-9b07-365e02c0fc25" acquired by "delete_volume" :: waited 0.027s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:32 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476" returned: 0 in 0.303s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dccd6d-e1ba-40fa-9e12-9acb91da4302]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "cinder-quobyte-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476" released by "delete_volume" :: held 0.755s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Created reservations ['5bbd086c-0e59-43f9-a128-e90e2e3b97b5', 'e125e5f1-97ff-44b8-a13f-8e1ed43240ee', '052b813f-23ae-4060-b7d8-cf881ca7d40c', '3d9f6616-15f9-4704-8d04-ff7c83ea9a6a'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:54:32 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 Jul 24 15:54:32 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:32 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:54:32 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:32 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25" returned: 0 in 0.415s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:32 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.293s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:54:32 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Deleted volume successfully. Jul 24 15:54:32 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25 Jul 24 15:54:32 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b12ece5d-aeca-4f86-9b8a-40daef955bd1 tempest-VolumesListAdminTestJSON-2078589268 None] Lock "cinder-07fdd67c-9ee1-4ecd-85a0-e6626ef2e476-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:33 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ed364a6f-c686-4b2c-9b07-365e02c0fc25" returned: 0 in 0.287s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Lock "cinder-quobyte-ed364a6f-c686-4b2c-9b07-365e02c0fc25" released by "delete_volume" :: held 0.757s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:33 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Created reservations ['66719ab8-e6fe-40af-bd05-d0cb5466eee5', '24e08ab1-2132-4c3d-9878-37c0911c475d', '77a5a5cb-4521-4c8d-9427-c3737a92e01a', 'eb24d631-f43d-4a03-8e14-9586f1bf96f1'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:54:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:33 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:54:33 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:33 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.300s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:33 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:54:33 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Deleted volume successfully. Jul 24 15:54:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ce8f91c4-8b48-40fb-9fa5-7de27a49d38f tempest-VolumesExtendTest-2012521796 None] Lock "cinder-ed364a6f-c686-4b2c-9b07-365e02c0fc25-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Flow 'volume_create_manager' (c2a710c9-03a9-43d3-9567-71c71b5e9dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd91ef2-a35b-431e-a32b-695bb40454a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd91ef2-a35b-431e-a32b-695bb40454a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1422689679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2467500b-f3a6-4795-a78d-e6ee43bf4d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac63c534a6e843a3b5627f417617a8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:34Z,use_quota=True,user_id='100877f6674a4403b74297dc87feb653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76ae7a4-1f75-4d76-9545-50a5f630d81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f76ae7a4-1f75-4d76-9545-50a5f630d81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b97f2b-d852-4340-bdab-0621228f47aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b97f2b-d852-4340-bdab-0621228f47aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2467500b-f3a6-4795-a78d-e6ee43bf4d1a', 'volume_name': 'volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8159c6e8-c643-4d87-8e39-3b1a60dc0204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8159c6e8-c643-4d87-8e39-3b1a60dc0204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae36e25-1d92-47d3-b908-48c332632adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:34 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Volume 2467500b-f3a6-4795-a78d-e6ee43bf4d1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a', 'volume_size': 1} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1422689679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2467500b-f3a6-4795-a78d-e6ee43bf4d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac63c534a6e843a3b5627f417617a8a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:34Z,use_quota=True,user_id='100877f6674a4403b74297dc87feb653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Creating volume 2467500b-f3a6-4795-a78d-e6ee43bf4d1a {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:34 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:34 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a 1073741824 Jul 24 15:54:34 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:34 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a 1073741824" returned: 0 in 0.555s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:34 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a Jul 24 15:54:34 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:35 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a" returned: 0 in 0.308s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae36e25-1d92-47d3-b908-48c332632adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf674e8-d028-45f6-ace7-09ad9ea00aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:35 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Volume volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a (2467500b-f3a6-4795-a78d-e6ee43bf4d1a): created successfully Jul 24 15:54:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf674e8-d028-45f6-ace7-09ad9ea00aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Flow 'volume_create_manager' (c2a710c9-03a9-43d3-9567-71c71b5e9dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:35 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3f28a112-74d6-4bd3-a398-5960f7f102d3 tempest-VolumesExtendTest-2012521796 None] Created volume successfully. Jul 24 15:54:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:36 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] Creating offline snapshot 05226182-9ada-43b9-8a18-ad982378d9a1 of volume 2467500b-f3a6-4795-a78d-e6ee43bf4d1a {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:54:36 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d831e4-f664-4207-bfb6-258faddf870c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:36 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a Jul 24 15:54:36 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:36 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a" returned: 0 in 0.451s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:37 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 1G Jul 24 15:54:37 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:37 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 1G" returned: 0 in 0.567s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:37 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 Jul 24 15:54:37 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:37 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1" returned: 0 in 0.377s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:37 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 is being set with open permissions: ugo+rw Jul 24 15:54:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:37 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 Jul 24 15:54:37 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:38 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1" returned: 0 in 0.287s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:38 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.info Jul 24 15:54:38 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:38 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.info" returned: 0 in 0.323s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:38 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.info is being set with open permissions: ugo+rw Jul 24 15:54:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:38 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.info Jul 24 15:54:38 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:38 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.info" returned: 0 in 0.304s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.450s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:38 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-74f78fec-d58e-4ed3-93ec-6124b0f5ce96 tempest-VolumesExtendTest-2012521796 None] Create snapshot completed successfully Jul 24 15:54:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-56d9f2e8-626c-4049-8c95-a50507c9478d tempest-VolumesExtendTest-2012521796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-56d9f2e8-626c-4049-8c95-a50507c9478d tempest-VolumesExtendTest-2012521796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:39 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1e624b-7ed2-45bb-a985-8ec146cb3007]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56d9f2e8-626c-4049-8c95-a50507c9478d tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:39 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a Jul 24 15:54:39 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:54:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:40 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:54:40 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:40 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56d9f2e8-626c-4049-8c95-a50507c9478d tempest-VolumesExtendTest-2012521796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a" returned: 0 in 0.443s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:40 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56d9f2e8-626c-4049-8c95-a50507c9478d tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 2G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.324s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56d9f2e8-626c-4049-8c95-a50507c9478d tempest-VolumesExtendTest-2012521796 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 2G" returned: 0 in 0.171s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-56d9f2e8-626c-4049-8c95-a50507c9478d tempest-VolumesExtendTest-2012521796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.665s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:40 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-56d9f2e8-626c-4049-8c95-a50507c9478d tempest-VolumesExtendTest-2012521796 None] Extend volume completed successfully. Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Flow 'volume_create_manager' (e2e0b978-2a65-44a0-8d35-c389a2da3be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e995c9e6-e2dd-4146-be04-7b0ae537b0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e995c9e6-e2dd-4146-be04-7b0ae537b0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1025760322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379647b9-b7eb-4ad1-82e4-0b95f98645aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6800700b6b12482b95a89e68da8ff324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:41Z,use_quota=True,user_id='533c32ab86ba43b3a3255b9faa98ae5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c7ed9c9-1244-4936-8deb-33e432c4c639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c7ed9c9-1244-4936-8deb-33e432c4c639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73c87a1-40e2-425c-ad96-27c7c3b60909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73c87a1-40e2-425c-ad96-27c7c3b60909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '379647b9-b7eb-4ad1-82e4-0b95f98645aa', 'volume_name': 'volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554abb1a-3dbf-48c0-9c2b-0b8f14bcf2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (554abb1a-3dbf-48c0-9c2b-0b8f14bcf2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b53125-a3ca-43eb-a27f-4a503561749e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:40 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Volume 379647b9-b7eb-4ad1-82e4-0b95f98645aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa', 'volume_size': 1} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1025760322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379647b9-b7eb-4ad1-82e4-0b95f98645aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6800700b6b12482b95a89e68da8ff324',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:41Z,use_quota=True,user_id='533c32ab86ba43b3a3255b9faa98ae5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Creating volume 379647b9-b7eb-4ad1-82e4-0b95f98645aa {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:40 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:54:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:40 devstack sudo[102276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa 1073741824 Jul 24 15:54:40 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Acquiring lock "cinder-05226182-9ada-43b9-8a18-ad982378d9a1-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Lock "cinder-05226182-9ada-43b9-8a18-ad982378d9a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Acquiring lock "cinder-quobyte-2467500b-f3a6-4795-a78d-e6ee43bf4d1a" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Lock "cinder-quobyte-2467500b-f3a6-4795-a78d-e6ee43bf4d1a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Acquiring lock "cinder-quobyte-05226182-9ada-43b9-8a18-ad982378d9a1" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Lock "cinder-quobyte-05226182-9ada-43b9-8a18-ad982378d9a1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Deleting offline snapshot 05226182-9ada-43b9-8a18-ad982378d9a1 of volume 2467500b-f3a6-4795-a78d-e6ee43bf4d1a {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] snapshot_file for this snap is: volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f3bb9c-b6f7-4ee1-9d36-4a1eeb18a478]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:41 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 Jul 24 15:54:41 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:41 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa 1073741824" returned: 0 in 0.553s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:41 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa Jul 24 15:54:41 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:41 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1" returned: 0 in 0.480s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd0e4aa-c76a-498e-b49a-047d137f500f]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:41 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a Jul 24 15:54:41 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:41 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa" returned: 0 in 0.287s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b53125-a3ca-43eb-a27f-4a503561749e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd30816-f302-4239-b278-a851a64065d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:41 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Volume volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa (379647b9-b7eb-4ad1-82e4-0b95f98645aa): created successfully Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd30816-f302-4239-b278-a851a64065d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Flow 'volume_create_manager' (e2e0b978-2a65-44a0-8d35-c389a2da3be9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:41 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-927ef65d-4111-48f3-b0b5-db13668421b2 tempest-VolumesMetadataTest-135448305 None] Created volume successfully. Jul 24 15:54:42 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a" returned: 0 in 0.414s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:42 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 Jul 24 15:54:42 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:42 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1" returned: 0 in 0.398s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:42 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1 Jul 24 15:54:42 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:42 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a.05226182-9ada-43b9-8a18-ad982378d9a1" returned: 0 in 0.251s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Lock "cinder-quobyte-05226182-9ada-43b9-8a18-ad982378d9a1" released by "_delete_snapshot" :: held 1.669s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Lock "cinder-quobyte-2467500b-f3a6-4795-a78d-e6ee43bf4d1a" released by "delete_snapshot" :: held 1.699s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:42 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Created reservations ['07909037-388a-46b0-b941-f235d32d35fe', '97220ee6-176f-448d-8fba-01d902e09fce', 'b20003dc-f9d1-463c-b85b-88d3d8f1bba5', 'd0084859-dc4e-48f6-9052-dadd84ef5980'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:54:42 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Delete snapshot completed successfully. Jul 24 15:54:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5540beb8-b00e-4985-9d30-d10063317db3 tempest-VolumesExtendTest-2012521796 None] Lock "cinder-05226182-9ada-43b9-8a18-ad982378d9a1-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Acquiring lock "cinder-2467500b-f3a6-4795-a78d-e6ee43bf4d1a-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Lock "cinder-2467500b-f3a6-4795-a78d-e6ee43bf4d1a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Acquiring lock "cinder-quobyte-2467500b-f3a6-4795-a78d-e6ee43bf4d1a" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Lock "cinder-quobyte-2467500b-f3a6-4795-a78d-e6ee43bf4d1a" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:43 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fa321e-6e0b-4f59-adfc-e255bbe61dff]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:43 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a Jul 24 15:54:43 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Acquiring lock "cinder-379647b9-b7eb-4ad1-82e4-0b95f98645aa-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Lock "cinder-379647b9-b7eb-4ad1-82e4-0b95f98645aa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Acquiring lock "cinder-quobyte-379647b9-b7eb-4ad1-82e4-0b95f98645aa" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Lock "cinder-quobyte-379647b9-b7eb-4ad1-82e4-0b95f98645aa" acquired by "delete_volume" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:43 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[721e0f37-b7c3-4bf2-94d2-ab74fc21fed4]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:43 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a" returned: 0 in 0.449s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:44 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a Jul 24 15:54:44 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:44 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa Jul 24 15:54:44 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:44 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2467500b-f3a6-4795-a78d-e6ee43bf4d1a" returned: 0 in 0.267s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Lock "cinder-quobyte-2467500b-f3a6-4795-a78d-e6ee43bf4d1a" released by "delete_volume" :: held 0.802s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=163,cinder:SELECT=128,cinder:DELETE=14,cinder:INSERT=57 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=139,cinder:UPDATE=186,cinder:INSERT=45,cinder:DELETE=14 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:54:44 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa" returned: 0 in 0.419s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:44 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa Jul 24 15:54:44 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Created reservations ['f35ecad6-48a1-4fce-ab11-e622dc42b22e', '647a4582-d805-4577-84fb-8a39a6b4b1d3', 'f9ad4495-b5e8-46eb-a0d1-880493136b0f', '19d0151b-a200-49f5-b61c-44f10bad56d2'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:44 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:54:44 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:44 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-379647b9-b7eb-4ad1-82e4-0b95f98645aa" returned: 0 in 0.374s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Lock "cinder-quobyte-379647b9-b7eb-4ad1-82e4-0b95f98645aa" released by "delete_volume" :: held 0.856s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:44 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.302s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Created reservations ['051e91eb-d1b2-412b-ac56-a7372df2535d', '981cf10a-b1ca-4ba2-8fd5-e66dcfa260cd', 'b0d3b586-ad75-4c59-81df-59499ed5ce55', 'a36a7cfb-979a-458e-acbe-71317b1cd592'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:54:44 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Deleted volume successfully. Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bd04ec84-dfa4-4023-ae49-655725d0d50c tempest-VolumesExtendTest-2012521796 None] Lock "cinder-2467500b-f3a6-4795-a78d-e6ee43bf4d1a-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:44 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:54:44 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:45 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.427s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:45 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:54:45 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Deleted volume successfully. Jul 24 15:54:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0f73faae-d6cd-43be-a959-82cb0ef27c54 tempest-VolumesMetadataTest-135448305 None] Lock "cinder-379647b9-b7eb-4ad1-82e4-0b95f98645aa-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Flow 'volume_create_manager' (a29f0934-ee00-4e6b-8d75-211b01ca5c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da432c8e-82be-47a8-ae3d-ecf62567cac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da432c8e-82be-47a8-ae3d-ecf62567cac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-712551635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99047ba9-26b5-45bc-80ea-3662fd33fd5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a1a2aa1f72a4ba9bcde73f5081ece55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:49Z,use_quota=True,user_id='1d022a5dc31a425a8131d84e60e154bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10399853-33e8-455a-a0a1-5ac532e46387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10399853-33e8-455a-a0a1-5ac532e46387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49a2fb2-5e42-4b93-8102-4b7968b9b402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49a2fb2-5e42-4b93-8102-4b7968b9b402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99047ba9-26b5-45bc-80ea-3662fd33fd5d', 'volume_name': 'volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b978eb2-dba9-4f18-a66f-3f9068bc22f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b978eb2-dba9-4f18-a66f-3f9068bc22f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294ee59c-07a7-4d18-b1ec-6a4c1bb2c0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:49 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Volume 99047ba9-26b5-45bc-80ea-3662fd33fd5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d', 'volume_size': 1} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-712551635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99047ba9-26b5-45bc-80ea-3662fd33fd5d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a1a2aa1f72a4ba9bcde73f5081ece55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:49Z,use_quota=True,user_id='1d022a5dc31a425a8131d84e60e154bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Creating volume 99047ba9-26b5-45bc-80ea-3662fd33fd5d {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:49 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:49 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d 1073741824 Jul 24 15:54:49 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:49 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d 1073741824" returned: 0 in 0.576s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:49 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d Jul 24 15:54:49 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:50 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d" returned: 0 in 0.317s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (294ee59c-07a7-4d18-b1ec-6a4c1bb2c0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3471fe0e-2504-419c-912a-a9b4d840ae32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:50 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Volume volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d (99047ba9-26b5-45bc-80ea-3662fd33fd5d): created successfully Jul 24 15:54:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3471fe0e-2504-419c-912a-a9b4d840ae32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Flow 'volume_create_manager' (a29f0934-ee00-4e6b-8d75-211b01ca5c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:50 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-9bac12dd-ce8d-4eb3-b212-f328f04009d4 tempest-VolumesListTestJSON-1235378332 None] Created volume successfully. Jul 24 15:54:51 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:54:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Flow 'volume_create_manager' (5800efdb-d30b-4f43-953a-fcc94cbcdb8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28022ae-63e3-4a84-80af-a7179009f7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28022ae-63e3-4a84-80af-a7179009f7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-643009244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e61655c-04ed-4385-92fa-1a4010f59f23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a1a2aa1f72a4ba9bcde73f5081ece55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:52Z,use_quota=True,user_id='1d022a5dc31a425a8131d84e60e154bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcb0cce-a7ac-435d-800a-9753d17dea17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcb0cce-a7ac-435d-800a-9753d17dea17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a9959c-98c6-4732-a385-0953508082c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a9959c-98c6-4732-a385-0953508082c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e61655c-04ed-4385-92fa-1a4010f59f23', 'volume_name': 'volume-9e61655c-04ed-4385-92fa-1a4010f59f23', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd61a8a-935e-4385-a909-3b45c6f29dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd61a8a-935e-4385-a909-3b45c6f29dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e220a0a1-01ba-4e3d-9589-324de7adf631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:52 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Volume 9e61655c-04ed-4385-92fa-1a4010f59f23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e61655c-04ed-4385-92fa-1a4010f59f23', 'volume_size': 1} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-643009244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e61655c-04ed-4385-92fa-1a4010f59f23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a1a2aa1f72a4ba9bcde73f5081ece55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:52Z,use_quota=True,user_id='1d022a5dc31a425a8131d84e60e154bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Creating volume 9e61655c-04ed-4385-92fa-1a4010f59f23 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:52 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9e61655c-04ed-4385-92fa-1a4010f59f23 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:52 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9e61655c-04ed-4385-92fa-1a4010f59f23 1073741824 Jul 24 15:54:52 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:52 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9e61655c-04ed-4385-92fa-1a4010f59f23 1073741824" returned: 0 in 0.610s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9e61655c-04ed-4385-92fa-1a4010f59f23 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:52 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9e61655c-04ed-4385-92fa-1a4010f59f23 Jul 24 15:54:52 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:52 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9e61655c-04ed-4385-92fa-1a4010f59f23" returned: 0 in 0.271s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e220a0a1-01ba-4e3d-9589-324de7adf631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e61655c-04ed-4385-92fa-1a4010f59f23', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a437af11-a4d9-4002-873c-153802105d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:53 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Volume volume-9e61655c-04ed-4385-92fa-1a4010f59f23 (9e61655c-04ed-4385-92fa-1a4010f59f23): created successfully Jul 24 15:54:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a437af11-a4d9-4002-873c-153802105d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Flow 'volume_create_manager' (5800efdb-d30b-4f43-953a-fcc94cbcdb8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:53 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a6ac8a92-906b-434d-a29e-235ad2ac98db tempest-VolumesListTestJSON-1235378332 None] Created volume successfully. Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Flow 'volume_create_manager' (6939a4da-c8cb-429f-943c-b143de2b3390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e42f543-1640-4fea-bebe-4c3c33ef5014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e42f543-1640-4fea-bebe-4c3c33ef5014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-296080000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c42ddcb-5070-4d82-904d-097ceb9f4fa9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a1a2aa1f72a4ba9bcde73f5081ece55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:55Z,use_quota=True,user_id='1d022a5dc31a425a8131d84e60e154bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b89ad11-aa5e-4e70-83b0-132436348d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b89ad11-aa5e-4e70-83b0-132436348d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c89a68-789a-47f3-a593-0bb824f9bab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c89a68-789a-47f3-a593-0bb824f9bab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c42ddcb-5070-4d82-904d-097ceb9f4fa9', 'volume_name': 'volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ad6b87-7b08-4300-8bd0-24fe1a7cb42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ad6b87-7b08-4300-8bd0-24fe1a7cb42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a8cece-cc94-4f75-ba99-0140a3fc9c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:54 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Volume 2c42ddcb-5070-4d82-904d-097ceb9f4fa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9', 'volume_size': 1} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-296080000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c42ddcb-5070-4d82-904d-097ceb9f4fa9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9a1a2aa1f72a4ba9bcde73f5081ece55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:54:55Z,use_quota=True,user_id='1d022a5dc31a425a8131d84e60e154bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Creating volume 2c42ddcb-5070-4d82-904d-097ceb9f4fa9 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:54:54 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:54:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:54 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9 1073741824 Jul 24 15:54:54 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:55 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9 1073741824" returned: 0 in 0.602s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:55 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9 Jul 24 15:54:55 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:54:55 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Jul 24 15:54:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9" returned: 0 in 0.362s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:54:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:54:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:54:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00a8cece-cc94-4f75-ba99-0140a3fc9c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8271fc-34fd-40aa-b48d-f90b3318c604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:54:55 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Volume volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9 (2c42ddcb-5070-4d82-904d-097ceb9f4fa9): created successfully Jul 24 15:54:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8271fc-34fd-40aa-b48d-f90b3318c604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:54:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Flow 'volume_create_manager' (6939a4da-c8cb-429f-943c-b143de2b3390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:54:55 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7e4a2ed1-7adf-4a66-bf61-244c6ea32022 tempest-VolumesListTestJSON-1235378332 None] Created volume successfully. Jul 24 15:54:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Acquiring lock "cinder-2c42ddcb-5070-4d82-904d-097ceb9f4fa9-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Lock "cinder-2c42ddcb-5070-4d82-904d-097ceb9f4fa9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Acquiring lock "cinder-quobyte-2c42ddcb-5070-4d82-904d-097ceb9f4fa9" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:54:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Lock "cinder-quobyte-2c42ddcb-5070-4d82-904d-097ceb9f4fa9" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:54:59 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[72621d09-b20d-4544-86f5-70a9ba8b686e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:54:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:54:59 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9 Jul 24 15:54:59 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:00 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9" returned: 0 in 0.444s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:00 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9 Jul 24 15:55:00 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:00 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2c42ddcb-5070-4d82-904d-097ceb9f4fa9" returned: 0 in 0.306s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Lock "cinder-quobyte-2c42ddcb-5070-4d82-904d-097ceb9f4fa9" released by "delete_volume" :: held 0.806s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:00 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Created reservations ['81f9a9aa-319c-4cef-853c-4602d24b9199', 'e6eb8747-0565-42dd-8bdd-fe8bacc7633d', '784976a0-6b99-4702-8f74-c1464af528e8', 'd1c109d8-c5b4-41fa-ba2c-d24cbebf8bc8'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:00 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:55:00 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Acquiring lock "cinder-9e61655c-04ed-4385-92fa-1a4010f59f23-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Lock "cinder-9e61655c-04ed-4385-92fa-1a4010f59f23-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:01 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.358s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:01 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Acquiring lock "cinder-quobyte-9e61655c-04ed-4385-92fa-1a4010f59f23" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:01 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Deleted volume successfully. Jul 24 15:55:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Lock "cinder-quobyte-9e61655c-04ed-4385-92fa-1a4010f59f23" acquired by "delete_volume" :: waited 0.038s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-83dc0503-1a90-474a-be08-e2df4d5be1ba tempest-VolumesListTestJSON-1235378332 None] Lock "cinder-2c42ddcb-5070-4d82-904d-097ceb9f4fa9-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:01 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c305cc-642a-4b8e-9dd6-1ed4dde8b910]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9e61655c-04ed-4385-92fa-1a4010f59f23 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:01 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9e61655c-04ed-4385-92fa-1a4010f59f23 Jul 24 15:55:01 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:01 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9e61655c-04ed-4385-92fa-1a4010f59f23" returned: 0 in 0.493s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9e61655c-04ed-4385-92fa-1a4010f59f23 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:01 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9e61655c-04ed-4385-92fa-1a4010f59f23 Jul 24 15:55:01 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:01 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9e61655c-04ed-4385-92fa-1a4010f59f23" returned: 0 in 0.309s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Lock "cinder-quobyte-9e61655c-04ed-4385-92fa-1a4010f59f23" released by "delete_volume" :: held 0.865s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Created reservations ['bc92625b-414a-4679-a6e7-9c151122a7ab', '8b367e02-74f3-47be-8af2-875b2fad4352', '42c2952a-d6c0-4c93-ab88-124346bafd8d', '64d694e2-2c2f-4c17-a6f0-8a498b39ae72'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:02 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:55:02 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Acquiring lock "cinder-99047ba9-26b5-45bc-80ea-3662fd33fd5d-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Lock "cinder-99047ba9-26b5-45bc-80ea-3662fd33fd5d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Acquiring lock "cinder-quobyte-99047ba9-26b5-45bc-80ea-3662fd33fd5d" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Lock "cinder-quobyte-99047ba9-26b5-45bc-80ea-3662fd33fd5d" acquired by "delete_volume" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bef466e-5537-4641-96cb-23c42679d76e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:02 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.439s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:02 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Deleted volume successfully. Jul 24 15:55:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8efc0d84-4810-4512-982a-7cfd7b587dd7 tempest-VolumesListTestJSON-1235378332 None] Lock "cinder-9e61655c-04ed-4385-92fa-1a4010f59f23-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:02 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d Jul 24 15:55:02 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:03 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d" returned: 0 in 0.848s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:03 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d Jul 24 15:55:03 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Flow 'volume_create_manager' (afcf9667-1d53-4752-935e-1baf0654b571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8839ed45-0a2d-4bf4-b385-3292e77db950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8839ed45-0a2d-4bf4-b385-3292e77db950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1470904208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37ae1a9-a180-4f05-8967-abad569a07a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95897595987f4ae98b05e3980d3c5d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:04Z,use_quota=True,user_id='6f668d051d204bd0bd055f43db155ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169693aa-cdc7-46c3-aca0-8e6cf64b58ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (169693aa-cdc7-46c3-aca0-8e6cf64b58ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1de2e8-30d7-4e46-ab85-522bd9fbe434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1de2e8-30d7-4e46-ab85-522bd9fbe434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f37ae1a9-a180-4f05-8967-abad569a07a6', 'volume_name': 'volume-f37ae1a9-a180-4f05-8967-abad569a07a6', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedadae7-0786-42fc-9cc6-d992a79ff97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dedadae7-0786-42fc-9cc6-d992a79ff97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ea78e8-b1c3-4537-b245-942bc8cdd5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:03 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Volume f37ae1a9-a180-4f05-8967-abad569a07a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f37ae1a9-a180-4f05-8967-abad569a07a6', 'volume_size': 1} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1470904208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f37ae1a9-a180-4f05-8967-abad569a07a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95897595987f4ae98b05e3980d3c5d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:04Z,use_quota=True,user_id='6f668d051d204bd0bd055f43db155ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Creating volume f37ae1a9-a180-4f05-8967-abad569a07a6 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:55:03 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:03 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99047ba9-26b5-45bc-80ea-3662fd33fd5d" returned: 0 in 0.522s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Lock "cinder-quobyte-99047ba9-26b5-45bc-80ea-3662fd33fd5d" released by "delete_volume" :: held 1.452s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:03 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 1073741824 Jul 24 15:55:03 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Created reservations ['ca87a88d-47a4-4300-8177-b094a64cb3eb', 'f7ffb2e9-0653-472a-a1b2-dc4e94991d14', '08f2ad43-c220-4b5b-bd74-5d09e10f3230', '58dffde6-3130-48ae-aac6-4e4b63f038c9'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:04 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:55:04 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:04 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.323s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:04 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Deleted volume successfully. Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d1815b97-88c3-4a97-8a94-d57cb1765def tempest-VolumesListTestJSON-1235378332 None] Lock "cinder-99047ba9-26b5-45bc-80ea-3662fd33fd5d-delete_volume" released by "delete_volume" :: held 2.094s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:04 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 1073741824" returned: 0 in 0.619s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:04 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 Jul 24 15:55:04 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Flow 'volume_create_manager' (98beeb88-f389-4f14-b0cc-7d63696481fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4c0938-c684-4640-be02-38eb19ff4ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:04 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4c0938-c684-4640-be02-38eb19ff4ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-509297080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecc0016-72db-41eb-b58e-471e6f76a212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6a4deac0314d98884d7a2da67cdc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:05Z,use_quota=True,user_id='6bcf1936d03745e6b4114952afa86655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf255f0-645f-4c02-b8c2-1da796d3a2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cf255f0-645f-4c02-b8c2-1da796d3a2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20af3dc0-704e-4bec-b892-7c43aae0a4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20af3dc0-704e-4bec-b892-7c43aae0a4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ecc0016-72db-41eb-b58e-471e6f76a212', 'volume_name': 'volume-9ecc0016-72db-41eb-b58e-471e6f76a212', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01bbfd7-d146-44f1-9240-5a69dfcdc85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01bbfd7-d146-44f1-9240-5a69dfcdc85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5496cf-acde-46b7-b635-4c6359051e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:04 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Volume 9ecc0016-72db-41eb-b58e-471e6f76a212: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ecc0016-72db-41eb-b58e-471e6f76a212', 'volume_size': 1} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6" returned: 0 in 0.357s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-509297080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecc0016-72db-41eb-b58e-471e6f76a212,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6a4deac0314d98884d7a2da67cdc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:05Z,use_quota=True,user_id='6bcf1936d03745e6b4114952afa86655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Creating volume 9ecc0016-72db-41eb-b58e-471e6f76a212 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:55:04 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ea78e8-b1c3-4537-b245-942bc8cdd5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f37ae1a9-a180-4f05-8967-abad569a07a6', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e0ae04-9260-4296-8d83-52d8a9a7c7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:05 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212 1073741824 Jul 24 15:55:05 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:05 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Volume volume-f37ae1a9-a180-4f05-8967-abad569a07a6 (f37ae1a9-a180-4f05-8967-abad569a07a6): created successfully Jul 24 15:55:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e0ae04-9260-4296-8d83-52d8a9a7c7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Flow 'volume_create_manager' (afcf9667-1d53-4752-935e-1baf0654b571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:05 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-63ead246-7fea-49a9-9558-ccf96e6c03be tempest-TestStampPattern-677058618 None] Created volume successfully. Jul 24 15:55:05 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212 1073741824" returned: 0 in 0.573s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:05 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212 Jul 24 15:55:05 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:05 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212" returned: 0 in 0.311s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:55:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5496cf-acde-46b7-b635-4c6359051e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ecc0016-72db-41eb-b58e-471e6f76a212', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f158083e-5c96-40e0-b8a6-7f7813ecbe5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:05 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Volume volume-9ecc0016-72db-41eb-b58e-471e6f76a212 (9ecc0016-72db-41eb-b58e-471e6f76a212): created successfully Jul 24 15:55:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f158083e-5c96-40e0-b8a6-7f7813ecbe5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Flow 'volume_create_manager' (98beeb88-f389-4f14-b0cc-7d63696481fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:05 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f65d4423-e424-4803-b168-17021caa7379 tempest-VolumesSnapshotTestJSON-2066888531 None] Created volume successfully. Jul 24 15:55:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] Creating offline snapshot cf631fdf-95e0-4756-90f8-90c3acc5d882 of volume 9ecc0016-72db-41eb-b58e-471e6f76a212 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:55:07 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1c5126-6672-4d87-97ce-0588a4e4470b]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:07 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212 Jul 24 15:55:07 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:07 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212" returned: 0 in 0.466s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:07 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882 1G Jul 24 15:55:07 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:08 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882 1G" returned: 0 in 0.491s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ecc0016-72db-41eb-b58e-471e6f76a212 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:08 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ecc0016-72db-41eb-b58e-471e6f76a212 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882 Jul 24 15:55:08 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Flow 'volume_create_manager' (53c91576-5ee1-417e-ad00-3303336c630a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57d4d99-3232-4362-b884-47b1c75d2621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d57d4d99-3232-4362-b884-47b1c75d2621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-55115532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6219250d-5898-484b-8506-2a081496d86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f19f2c40024a9ba5a5493b03d018f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:08Z,use_quota=True,user_id='aad9f8470c36476e877685e322962d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08996389-5855-47c4-b4d7-7a518d2869c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08996389-5855-47c4-b4d7-7a518d2869c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f426f2c1-2158-4840-bfa7-7148ce4d2084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f426f2c1-2158-4840-bfa7-7148ce4d2084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6219250d-5898-484b-8506-2a081496d86a', 'volume_name': 'volume-6219250d-5898-484b-8506-2a081496d86a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e28cc4a-0f2e-4f7c-b264-a33152d872f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e28cc4a-0f2e-4f7c-b264-a33152d872f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39aabb1-ddda-4ca9-bd43-5560170704c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:08 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Volume 6219250d-5898-484b-8506-2a081496d86a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6219250d-5898-484b-8506-2a081496d86a', 'volume_size': 1} Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:08 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ecc0016-72db-41eb-b58e-471e6f76a212 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882" returned: 0 in 0.370s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:08 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882 is being set with open permissions: ugo+rw Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:08 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882 Jul 24 15:55:08 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:08 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882" returned: 0 in 0.260s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:09 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.info Jul 24 15:55:09 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:09 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.info" returned: 0 in 0.419s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:09 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.info is being set with open permissions: ugo+rw Jul 24 15:55:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:09 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.info Jul 24 15:55:09 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:09 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.info" returned: 0 in 0.418s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.577s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.218s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-55115532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6219250d-5898-484b-8506-2a081496d86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f19f2c40024a9ba5a5493b03d018f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:08Z,use_quota=True,user_id='aad9f8470c36476e877685e322962d5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:55:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Creating volume 6219250d-5898-484b-8506-2a081496d86a {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:55:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:55:09 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:55:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:09 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a 1073741824 Jul 24 15:55:09 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:10 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-fdfe89e2-df76-432d-8a3f-77637df8a46a tempest-VolumesSnapshotTestJSON-2066888531 None] Create snapshot completed successfully Jul 24 15:55:10 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a 1073741824" returned: 0 in 0.771s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:10 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-cf631fdf-95e0-4756-90f8-90c3acc5d882-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:10 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-cf631fdf-95e0-4756-90f8-90c3acc5d882-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:10 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a Jul 24 15:55:10 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:10 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-quobyte-9ecc0016-72db-41eb-b58e-471e6f76a212" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:10 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-9ecc0016-72db-41eb-b58e-471e6f76a212" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:10 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-quobyte-cf631fdf-95e0-4756-90f8-90c3acc5d882" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:10 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-cf631fdf-95e0-4756-90f8-90c3acc5d882" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Deleting offline snapshot cf631fdf-95e0-4756-90f8-90c3acc5d882 of volume 9ecc0016-72db-41eb-b58e-471e6f76a212 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:55:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] snapshot_file for this snap is: volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:55:10 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a6fd60-74ea-44d4-b56f-e68e04dce8e3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:11 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882 Jul 24 15:55:11 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:11 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a" returned: 0 in 0.296s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:55:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39aabb1-ddda-4ca9-bd43-5560170704c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6219250d-5898-484b-8506-2a081496d86a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fa0f1e-fb28-4f67-971a-8fbe4fddbfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:11 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Volume volume-6219250d-5898-484b-8506-2a081496d86a (6219250d-5898-484b-8506-2a081496d86a): created successfully Jul 24 15:55:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00fa0f1e-fb28-4f67-971a-8fbe4fddbfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Flow 'volume_create_manager' (53c91576-5ee1-417e-ad00-3303336c630a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:11 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-076c9160-f1fa-402a-a2f9-62c881845642 tempest-VolumesSnapshotListTestJSON-1364277204 None] Created volume successfully. Jul 24 15:55:11 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882" returned: 0 in 0.410s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ecc0016-72db-41eb-b58e-471e6f76a212(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:55:11 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[72179cfe-3135-48ac-89a9-b6dd57787f08]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:11 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212 Jul 24 15:55:11 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:11 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212" returned: 0 in 0.475s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:11 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882 Jul 24 15:55:11 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] Creating offline snapshot 6f191a0d-3836-4b82-a326-db2270066f3b of volume 6219250d-5898-484b-8506-2a081496d86a {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:55:12 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a50baf0-5ba6-433b-908e-7a18b31bfc9f]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:12 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882" returned: 0 in 0.606s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:12 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882 Jul 24 15:55:12 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:12 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a Jul 24 15:55:12 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:12 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212.cf631fdf-95e0-4756-90f8-90c3acc5d882" returned: 0 in 0.283s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-cf631fdf-95e0-4756-90f8-90c3acc5d882" released by "_delete_snapshot" :: held 1.909s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-9ecc0016-72db-41eb-b58e-471e6f76a212" released by "delete_snapshot" :: held 1.942s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:12 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a" returned: 0 in 0.438s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:12 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b 1G Jul 24 15:55:12 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:12 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Created reservations ['ad2df842-9dcc-4558-91c1-b350c76da29f', '9a46e8d2-0e4b-4cab-94a5-6c1f7b279dd1', '4c4ef243-ccf5-4210-bddd-7c2203f0ab7f', 'f9880dd9-9f45-4215-8fd9-8990d72cca83'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:12 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Delete snapshot completed successfully. Jul 24 15:55:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f1eaba2f-ea12-436e-8a2e-894b5e810b3e tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-cf631fdf-95e0-4756-90f8-90c3acc5d882-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:13 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b 1G" returned: 0 in 0.485s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6219250d-5898-484b-8506-2a081496d86a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:13 devstack sudo[103030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6219250d-5898-484b-8506-2a081496d86a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b Jul 24 15:55:13 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:13 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6219250d-5898-484b-8506-2a081496d86a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b" returned: 0 in 0.401s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:13 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b is being set with open permissions: ugo+rw Jul 24 15:55:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:13 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b Jul 24 15:55:13 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:13 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b" returned: 0 in 0.311s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:14 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.info Jul 24 15:55:14 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:14 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.info" returned: 0 in 0.432s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:14 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.info is being set with open permissions: ugo+rw Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:14 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.info Jul 24 15:55:14 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Flow 'volume_create_manager' (70ffcb60-59e7-4be0-8e1e-38558650856c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:14 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d45c0a-8c7e-4d77-b602-d8be79c4f9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.info" returned: 0 in 0.405s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.590s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d45c0a-8c7e-4d77-b602-d8be79c4f9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-621657794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f170084c-63d0-4ad3-be53-cc51a42aa2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6a4deac0314d98884d7a2da67cdc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:15Z,use_quota=True,user_id='6bcf1936d03745e6b4114952afa86655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2199e3-b669-449f-8008-6c04d9be91bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2199e3-b669-449f-8008-6c04d9be91bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8593aac-e848-48a8-b32d-c91e6dc61618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8593aac-e848-48a8-b32d-c91e6dc61618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f170084c-63d0-4ad3-be53-cc51a42aa2cb', 'volume_name': 'volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11103ac-cacb-47ec-acb3-cd7556c7fd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11103ac-cacb-47ec-acb3-cd7556c7fd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9f3533-8056-4543-9cea-ec0879319d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:14 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Volume f170084c-63d0-4ad3-be53-cc51a42aa2cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb', 'volume_size': 1} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-621657794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f170084c-63d0-4ad3-be53-cc51a42aa2cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6a4deac0314d98884d7a2da67cdc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:15Z,use_quota=True,user_id='6bcf1936d03745e6b4114952afa86655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Creating volume f170084c-63d0-4ad3-be53-cc51a42aa2cb {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:55:14 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:55:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:14 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-bf2b3c8c-8dcc-4538-9b80-a71aa58b5e73 tempest-VolumesSnapshotListTestJSON-1364277204 None] Create snapshot completed successfully Jul 24 15:55:15 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb 1073741824 Jul 24 15:55:15 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:15 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb 1073741824" returned: 0 in 0.527s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:15 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb Jul 24 15:55:15 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-87367eda-d6e0-4e95-8879-f7cae3dbb153 tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:15 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb" returned: 0 in 0.335s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:55:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-87367eda-d6e0-4e95-8879-f7cae3dbb153 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.090s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c9f3533-8056-4543-9cea-ec0879319d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7aac21-29f3-4317-9ea3-60d88857122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-87367eda-d6e0-4e95-8879-f7cae3dbb153 tempest-VolumesSnapshotListTestJSON-1364277204 None] Creating offline snapshot d9765956-914a-4096-a898-6f4772e08b98 of volume 6219250d-5898-484b-8506-2a081496d86a {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:55:15 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Volume volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb (f170084c-63d0-4ad3-be53-cc51a42aa2cb): created successfully Jul 24 15:55:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a7aac21-29f3-4317-9ea3-60d88857122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Flow 'volume_create_manager' (70ffcb60-59e7-4be0-8e1e-38558650856c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:15 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[573e7de8-00ea-4f63-a450-3657cf3ac01a]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-87367eda-d6e0-4e95-8879-f7cae3dbb153 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:16 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-06ae7d71-1412-48b6-9ebc-1acd54decef5 tempest-VolumesSnapshotTestJSON-2066888531 None] Created volume successfully. Jul 24 15:55:16 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b Jul 24 15:55:16 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:16 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-87367eda-d6e0-4e95-8879-f7cae3dbb153 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b" returned: 0 in 0.490s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-87367eda-d6e0-4e95-8879-f7cae3dbb153 tempest-VolumesSnapshotListTestJSON-1364277204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6219250d-5898-484b-8506-2a081496d86a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:55:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-87367eda-d6e0-4e95-8879-f7cae3dbb153 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:16 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 1G Jul 24 15:55:16 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:17 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-87367eda-d6e0-4e95-8879-f7cae3dbb153 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 1G" returned: 0 in 0.548s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-87367eda-d6e0-4e95-8879-f7cae3dbb153 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:17 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 Jul 24 15:55:17 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:17 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-87367eda-d6e0-4e95-8879-f7cae3dbb153 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98" returned: 0 in 0.381s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:17 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-87367eda-d6e0-4e95-8879-f7cae3dbb153 tempest-VolumesSnapshotListTestJSON-1364277204 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 is being set with open permissions: ugo+rw Jul 24 15:55:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-87367eda-d6e0-4e95-8879-f7cae3dbb153 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:17 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 Jul 24 15:55:17 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:17 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-87367eda-d6e0-4e95-8879-f7cae3dbb153 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98" returned: 0 in 0.249s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-87367eda-d6e0-4e95-8879-f7cae3dbb153 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.817s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.517s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] Creating offline snapshot e1297436-d8b0-4a4c-99a2-0cf70482ab98 of volume f170084c-63d0-4ad3-be53-cc51a42aa2cb {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:55:17 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-87367eda-d6e0-4e95-8879-f7cae3dbb153 tempest-VolumesSnapshotListTestJSON-1364277204 None] Create snapshot completed successfully Jul 24 15:55:17 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd8a149-c6f4-4954-8930-e2b00e1384cd]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:17 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb Jul 24 15:55:17 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a92fb08e-749d-4c6e-a663-868911c8d82a tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:18 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb" returned: 0 in 0.414s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:18 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 1G Jul 24 15:55:18 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:18 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 1G" returned: 0 in 0.395s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:18 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 Jul 24 15:55:18 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:18 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98" returned: 0 in 0.274s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:18 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 is being set with open permissions: ugo+rw Jul 24 15:55:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:18 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 Jul 24 15:55:18 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:19 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98" returned: 0 in 0.266s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:19 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.info Jul 24 15:55:19 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:19 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.info" returned: 0 in 0.249s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:19 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.info is being set with open permissions: ugo+rw Jul 24 15:55:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:19 devstack sudo[103109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.info Jul 24 15:55:19 devstack sudo[103109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:19 devstack sudo[103109]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.info" returned: 0 in 0.247s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a92fb08e-749d-4c6e-a663-868911c8d82a tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.620s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a92fb08e-749d-4c6e-a663-868911c8d82a tempest-VolumesSnapshotListTestJSON-1364277204 None] Creating offline snapshot cf602019-1598-488e-ad9e-afea24389202 of volume 6219250d-5898-484b-8506-2a081496d86a {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:55:19 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-df0e227f-2728-466d-bde0-76d97563003e tempest-VolumesSnapshotTestJSON-2066888531 None] Create snapshot completed successfully Jul 24 15:55:19 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3860064a-7080-48a3-aa24-4dee3bd90391]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a92fb08e-749d-4c6e-a663-868911c8d82a tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:19 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 Jul 24 15:55:19 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:20 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a92fb08e-749d-4c6e-a663-868911c8d82a tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98" returned: 0 in 0.361s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a92fb08e-749d-4c6e-a663-868911c8d82a tempest-VolumesSnapshotListTestJSON-1364277204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6219250d-5898-484b-8506-2a081496d86a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:55:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a92fb08e-749d-4c6e-a663-868911c8d82a tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:20 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202 1G Jul 24 15:55:20 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:20 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a92fb08e-749d-4c6e-a663-868911c8d82a tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202 1G" returned: 0 in 0.495s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a92fb08e-749d-4c6e-a663-868911c8d82a tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:20 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202 Jul 24 15:55:20 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:20 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:55:20 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a92fb08e-749d-4c6e-a663-868911c8d82a tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202" returned: 0 in 0.344s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:20 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-a92fb08e-749d-4c6e-a663-868911c8d82a tempest-VolumesSnapshotListTestJSON-1364277204 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202 is being set with open permissions: ugo+rw Jul 24 15:55:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a92fb08e-749d-4c6e-a663-868911c8d82a tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:20 devstack sudo[103129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202 Jul 24 15:55:20 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Flow 'volume_create_manager' (c4125128-9c98-472a-b1a0-80e177b25967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687d3cc1-4ded-45f9-83ba-1b9f1b0db541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687d3cc1-4ded-45f9-83ba-1b9f1b0db541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-400222305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d957f500-00fc-4c2d-b206-99bad874ce03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6a4deac0314d98884d7a2da67cdc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e1297436-d8b0-4a4c-99a2-0cf70482ab98,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:21Z,use_quota=True,user_id='6bcf1936d03745e6b4114952afa86655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518cce1a-f2f5-41c3-b7c0-f9b45bb31af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (518cce1a-f2f5-41c3-b7c0-f9b45bb31af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6f8189-efa7-4307-bbe5-4252bb61f3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6f8189-efa7-4307-bbe5-4252bb61f3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd957f500-00fc-4c2d-b206-99bad874ce03', 'volume_name': 'volume-d957f500-00fc-4c2d-b206-99bad874ce03', 'volume_size': 2, 'snapshot_id': 'e1297436-d8b0-4a4c-99a2-0cf70482ab98'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688d51f7-0fd3-4fe7-ae35-47c850fda957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688d51f7-0fd3-4fe7-ae35-47c850fda957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3bfd46-be3a-46d2-8c99-9239a34cf50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:21 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Volume d957f500-00fc-4c2d-b206-99bad874ce03: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d957f500-00fc-4c2d-b206-99bad874ce03', 'volume_size': 2, 'snapshot_id': 'e1297436-d8b0-4a4c-99a2-0cf70482ab98'} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:21 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a92fb08e-749d-4c6e-a663-868911c8d82a tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202" returned: 0 in 0.266s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a92fb08e-749d-4c6e-a663-868911c8d82a tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.582s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.168s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-quobyte-e1297436-d8b0-4a4c-99a2-0cf70482ab98-d957f500-00fc-4c2d-b206-99bad874ce03" by "_create_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-e1297436-d8b0-4a4c-99a2-0cf70482ab98-d957f500-00fc-4c2d-b206-99bad874ce03" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Creating volume d957f500-00fc-4c2d-b206-99bad874ce03 from snapshot e1297436-d8b0-4a4c-99a2-0cf70482ab98 {{(pid=88350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-quobyte-d957f500-00fc-4c2d-b206-99bad874ce03" by "_copy_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:21 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a92fb08e-749d-4c6e-a663-868911c8d82a tempest-VolumesSnapshotListTestJSON-1364277204 None] Create snapshot completed successfully Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-d957f500-00fc-4c2d-b206-99bad874ce03" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] snapshot: e1297436-d8b0-4a4c-99a2-0cf70482ab98, volume: d957f500-00fc-4c2d-b206-99bad874ce03, {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f30d33c-52b6-478a-9fda-61e4ede278bc]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:21 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 Jul 24 15:55:21 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:21 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98" returned: 0 in 0.370s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Creating direct copy from snapshot {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[65210745-5574-401c-b9f7-44cdcfa491de]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:21 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb Jul 24 15:55:21 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:22 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb" returned: 0 in 0.390s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:22 devstack cinder-volume[88350]: DEBUG cinder.utils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Path /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d957f500-00fc-4c2d-b206-99bad874ce03 not found in is_blk_device check {{(pid=88350) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:55:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d957f500-00fc-4c2d-b206-99bad874ce03 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:22 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d957f500-00fc-4c2d-b206-99bad874ce03 Jul 24 15:55:22 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "cinder-cf602019-1598-488e-ad9e-afea24389202-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-cf602019-1598-488e-ad9e-afea24389202-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "cinder-quobyte-6219250d-5898-484b-8506-2a081496d86a" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-quobyte-6219250d-5898-484b-8506-2a081496d86a" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "cinder-quobyte-cf602019-1598-488e-ad9e-afea24389202" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-quobyte-cf602019-1598-488e-ad9e-afea24389202" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Deleting offline snapshot cf602019-1598-488e-ad9e-afea24389202 of volume 6219250d-5898-484b-8506-2a081496d86a {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:55:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] snapshot_file for this snap is: volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:55:24 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c86cd3e-a3e4-4c13-bc20-4fd32929486d]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:24 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202 Jul 24 15:55:24 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:25 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202" returned: 0 in 1.179s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6219250d-5898-484b-8506-2a081496d86a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:55:25 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52a3953-0b11-451c-aa53-8fc465154441]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:25 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 Jul 24 15:55:25 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:26 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98" returned: 0 in 0.809s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:26 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6219250d-5898-484b-8506-2a081496d86a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:55:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:26 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202 Jul 24 15:55:26 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:27 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202" returned: 0 in 1.051s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:27 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202 Jul 24 15:55:27 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:27 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d957f500-00fc-4c2d-b206-99bad874ce03" returned: 0 in 5.646s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:27 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[169e1421-e6bd-42e4-a4d3-cbb4e35feaa1]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:27 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.cf602019-1598-488e-ad9e-afea24389202" returned: 0 in 0.355s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-quobyte-cf602019-1598-488e-ad9e-afea24389202" released by "_delete_snapshot" :: held 3.674s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-quobyte-6219250d-5898-484b-8506-2a081496d86a" released by "delete_snapshot" :: held 3.727s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:27 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Created reservations ['3be41fff-0fff-4723-844b-948a4b6b05a6', 'd7d9a3b8-0148-433b-8cab-aa567efd3c6f', 'f1329007-dfbb-4820-99b0-0b300a8e6c83', 'e8f0c146-1d53-4d6d-8742-df7c67e2b065'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:27 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb Jul 24 15:55:27 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:27 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Delete snapshot completed successfully. Jul 24 15:55:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-50e4a7ef-9964-4fd9-ae2b-323c15a418ee tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-cf602019-1598-488e-ad9e-afea24389202-delete_snapshot" released by "delete_snapshot" :: held 3.896s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:28 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb" returned: 0 in 0.592s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Image conversion details: src /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb, size 1024.00 MB, duration 5.65 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d957f500-00fc-4c2d-b206-99bad874ce03 {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:55:28 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Converted 1024.00 MB image at 181.32 MB/s Jul 24 15:55:28 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d957f500-00fc-4c2d-b206-99bad874ce03 is being set with open permissions: ugo+rw Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d957f500-00fc-4c2d-b206-99bad874ce03 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:28 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d957f500-00fc-4c2d-b206-99bad874ce03 Jul 24 15:55:28 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "cinder-d9765956-914a-4096-a898-6f4772e08b98-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-d9765956-914a-4096-a898-6f4772e08b98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "cinder-quobyte-6219250d-5898-484b-8506-2a081496d86a" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-quobyte-6219250d-5898-484b-8506-2a081496d86a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "cinder-quobyte-d9765956-914a-4096-a898-6f4772e08b98" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-quobyte-d9765956-914a-4096-a898-6f4772e08b98" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Deleting offline snapshot d9765956-914a-4096-a898-6f4772e08b98 of volume 6219250d-5898-484b-8506-2a081496d86a {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] snapshot_file for this snap is: volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[674630b6-16b8-4133-bdb6-de4857ed13cc]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:28 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d957f500-00fc-4c2d-b206-99bad874ce03" returned: 0 in 0.274s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-d957f500-00fc-4c2d-b206-99bad874ce03" released by "_copy_volume_from_snapshot" :: held 7.367s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-e1297436-d8b0-4a4c-99a2-0cf70482ab98-d957f500-00fc-4c2d-b206-99bad874ce03" released by "_create_volume_from_snapshot" :: held 7.404s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.425s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:28 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 Jul 24 15:55:28 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3bfd46-be3a-46d2-8c99-9239a34cf50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d957f500-00fc-4c2d-b206-99bad874ce03', 'volume_size': 2, 'snapshot_id': 'e1297436-d8b0-4a4c-99a2-0cf70482ab98'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e11d7f3-093d-45ea-a668-274390811bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:28 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Volume volume-d957f500-00fc-4c2d-b206-99bad874ce03 (d957f500-00fc-4c2d-b206-99bad874ce03): created successfully Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e11d7f3-093d-45ea-a668-274390811bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Flow 'volume_create_manager' (c4125128-9c98-472a-b1a0-80e177b25967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:28 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e99f2549-da0d-4dc3-9944-cf2665dcb0e2 tempest-VolumesSnapshotTestJSON-2066888531 None] Created volume successfully. Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-d957f500-00fc-4c2d-b206-99bad874ce03-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:28 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98" returned: 0 in 0.387s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6219250d-5898-484b-8506-2a081496d86a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:55:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-d957f500-00fc-4c2d-b206-99bad874ce03-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[779c1e55-6354-4eeb-b41a-b85dc9e545b5]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-quobyte-d957f500-00fc-4c2d-b206-99bad874ce03" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-d957f500-00fc-4c2d-b206-99bad874ce03" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a094f8f9-63fa-4d9f-82be-83e0a1792d6d]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d957f500-00fc-4c2d-b206-99bad874ce03 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:29 devstack sudo[103220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b Jul 24 15:55:29 devstack sudo[103220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:29 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d957f500-00fc-4c2d-b206-99bad874ce03 Jul 24 15:55:29 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:29 devstack sudo[103220]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b" returned: 0 in 0.367s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6219250d-5898-484b-8506-2a081496d86a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:29 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 Jul 24 15:55:29 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:29 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d957f500-00fc-4c2d-b206-99bad874ce03" returned: 0 in 0.370s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d957f500-00fc-4c2d-b206-99bad874ce03 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:29 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d957f500-00fc-4c2d-b206-99bad874ce03 Jul 24 15:55:29 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:29 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d957f500-00fc-4c2d-b206-99bad874ce03" returned: 0 in 0.249s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-d957f500-00fc-4c2d-b206-99bad874ce03" released by "delete_volume" :: held 0.669s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:29 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98" returned: 0 in 0.373s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:29 devstack sudo[103238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98 Jul 24 15:55:29 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Created reservations ['cd68f624-d97a-43b2-bdfb-23dfb67e8afe', 'b102fbab-d77b-4730-a6ab-8331fd36dc22', 'a5cfa4b1-5812-4acf-8e01-0caddc24f93f', '677c690a-f8e4-42fc-beeb-a5de6de7216f'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:29 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:55:29 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:30 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.d9765956-914a-4096-a898-6f4772e08b98" returned: 0 in 0.264s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-quobyte-d9765956-914a-4096-a898-6f4772e08b98" released by "_delete_snapshot" :: held 1.513s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-quobyte-6219250d-5898-484b-8506-2a081496d86a" released by "delete_snapshot" :: held 1.543s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:30 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.275s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Created reservations ['cfd7141d-ce44-41c7-82a1-748d6babae88', 'a40eeaef-4647-451f-99c3-654c076f0206', '42d4bb1f-342d-4c80-886f-d21c46a24899', 'db310252-ccff-4a0b-99a3-a33c102c8d6c'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:30 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Deleted volume successfully. Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4687a036-1842-4890-b774-8c2fe41cce71 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-d957f500-00fc-4c2d-b206-99bad874ce03-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-e1297436-d8b0-4a4c-99a2-0cf70482ab98-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-e1297436-d8b0-4a4c-99a2-0cf70482ab98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-quobyte-f170084c-63d0-4ad3-be53-cc51a42aa2cb" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-f170084c-63d0-4ad3-be53-cc51a42aa2cb" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-quobyte-e1297436-d8b0-4a4c-99a2-0cf70482ab98" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:30 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Delete snapshot completed successfully. Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-e1297436-d8b0-4a4c-99a2-0cf70482ab98" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Deleting offline snapshot e1297436-d8b0-4a4c-99a2-0cf70482ab98 of volume f170084c-63d0-4ad3-be53-cc51a42aa2cb {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] snapshot_file for this snap is: volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-79d99aea-58fc-4a57-bb19-3cc4076b8717 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-d9765956-914a-4096-a898-6f4772e08b98-delete_snapshot" released by "delete_snapshot" :: held 1.794s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d37966-f62a-4dd0-9ad8-6a2c05fb4970]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:30 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 Jul 24 15:55:30 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "cinder-6f191a0d-3836-4b82-a326-db2270066f3b-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-6f191a0d-3836-4b82-a326-db2270066f3b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "cinder-quobyte-6219250d-5898-484b-8506-2a081496d86a" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:30 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98" returned: 0 in 0.385s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-quobyte-6219250d-5898-484b-8506-2a081496d86a" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "cinder-quobyte-6f191a0d-3836-4b82-a326-db2270066f3b" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e0ddb-360c-4e95-b535-fe2c9632d015]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-quobyte-6f191a0d-3836-4b82-a326-db2270066f3b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Deleting offline snapshot 6f191a0d-3836-4b82-a326-db2270066f3b of volume 6219250d-5898-484b-8506-2a081496d86a {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] snapshot_file for this snap is: volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5864ecf7-1b71-4403-984f-b7e1c4fa27a0]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:30 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb Jul 24 15:55:30 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:30 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b Jul 24 15:55:30 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:31 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb" returned: 0 in 0.381s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:31 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 Jul 24 15:55:31 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:31 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b" returned: 0 in 0.373s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6219250d-5898-484b-8506-2a081496d86a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6efb386-6fa3-423a-b49d-5bddc03ee3e7]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:31 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a Jul 24 15:55:31 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:31 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98" returned: 0 in 0.332s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:31 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98 Jul 24 15:55:31 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:31 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a" returned: 0 in 0.367s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:31 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b Jul 24 15:55:31 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:31 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb.e1297436-d8b0-4a4c-99a2-0cf70482ab98" returned: 0 in 0.260s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-e1297436-d8b0-4a4c-99a2-0cf70482ab98" released by "_delete_snapshot" :: held 1.476s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-f170084c-63d0-4ad3-be53-cc51a42aa2cb" released by "delete_snapshot" :: held 1.502s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Created reservations ['1be7bd28-d8f0-4200-9963-ff170a8f14dc', 'a52151ae-ff49-4728-ac2c-f5a188b00bc0', '57a38407-dca8-4ac8-8351-b48bd49d519c', '20975c83-ca1c-45a8-b6e6-b471e2e1cf0e'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:31 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Delete snapshot completed successfully. Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5caefcc4-c3cf-4c9c-9578-f05df095edc3 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-e1297436-d8b0-4a4c-99a2-0cf70482ab98-delete_snapshot" released by "delete_snapshot" :: held 1.670s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:31 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b" returned: 0 in 0.369s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:31 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b Jul 24 15:55:31 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:32 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a.6f191a0d-3836-4b82-a326-db2270066f3b" returned: 0 in 0.256s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-quobyte-6f191a0d-3836-4b82-a326-db2270066f3b" released by "_delete_snapshot" :: held 1.473s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-quobyte-6219250d-5898-484b-8506-2a081496d86a" released by "delete_snapshot" :: held 1.506s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:32 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Created reservations ['ace89404-a6fb-4112-9b0a-7e6c17ebe804', '539e6c58-bd0b-404e-bfac-178759fbcb62', '2c61688a-3f5f-40e5-952a-f478a8e606bc', '35c4f729-a9f8-4726-ace8-3fbab4a20ae1'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:32 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Delete snapshot completed successfully. Jul 24 15:55:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1c4ed498-126d-4cc9-a8e7-d46db49b1676 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-6f191a0d-3836-4b82-a326-db2270066f3b-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-f170084c-63d0-4ad3-be53-cc51a42aa2cb-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-f170084c-63d0-4ad3-be53-cc51a42aa2cb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-quobyte-f170084c-63d0-4ad3-be53-cc51a42aa2cb" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-f170084c-63d0-4ad3-be53-cc51a42aa2cb" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:32 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a25411f-2a30-4838-9c23-6a19e90af41d]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:32 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb Jul 24 15:55:32 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "cinder-6219250d-5898-484b-8506-2a081496d86a-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-6219250d-5898-484b-8506-2a081496d86a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "cinder-quobyte-6219250d-5898-484b-8506-2a081496d86a" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:32 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-quobyte-6219250d-5898-484b-8506-2a081496d86a" acquired by "delete_volume" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb" returned: 0 in 0.483s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52ad021-9bdc-4ee0-88a6-eab1119f1107]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:33 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb Jul 24 15:55:33 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:33 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a Jul 24 15:55:33 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:33 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f170084c-63d0-4ad3-be53-cc51a42aa2cb" returned: 0 in 0.315s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-f170084c-63d0-4ad3-be53-cc51a42aa2cb" released by "delete_volume" :: held 0.869s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Created reservations ['6f61f297-9a75-4413-ae52-54218e759c5e', '4221908c-5eca-4474-ade9-3375ac98eb68', '9acd6535-9b1e-4326-9a6b-e447c07c3af4', 'de0da445-32cc-427a-a79f-a5d522838b85'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:33 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a" returned: 0 in 0.469s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:33 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a Jul 24 15:55:33 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:33 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:55:33 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:33 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:33 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6219250d-5898-484b-8506-2a081496d86a" returned: 0 in 0.351s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.301s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:33 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Deleted volume successfully. Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-quobyte-6219250d-5898-484b-8506-2a081496d86a" released by "delete_volume" :: held 0.913s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c7401443-a7fd-4f20-a3c1-8af7e011acc1 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-f170084c-63d0-4ad3-be53-cc51a42aa2cb-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Created reservations ['6d79cf34-98e4-406b-9ace-d94d19240d42', 'fa11e9a7-b5d3-4134-ac2a-a6ee913cda09', '8d1add4c-78ef-43b5-965c-032705644007', 'f994aa39-5235-44c8-b0e2-489bfd9f1303'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:34 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:55:34 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Flow 'volume_create_manager' (bbebc2af-3605-48c8-bfba-57bb163a4a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29395fe5-fcdf-4c8c-927b-15012054a13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29395fe5-fcdf-4c8c-927b-15012054a13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1379185616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f192d154-a57e-4c48-8a21-7c5f22d5cffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6a4deac0314d98884d7a2da67cdc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:34Z,use_quota=True,user_id='6bcf1936d03745e6b4114952afa86655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a7a43c-69d9-4bd6-bbc9-5e4ef2057972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48a7a43c-69d9-4bd6-bbc9-5e4ef2057972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a40241-9cfa-4188-a5f0-5d75441178c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a40241-9cfa-4188-a5f0-5d75441178c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f192d154-a57e-4c48-8a21-7c5f22d5cffc', 'volume_name': 'volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3c5e61-ced8-46cd-95fd-ccf3ba2d6758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3c5e61-ced8-46cd-95fd-ccf3ba2d6758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d589e1-5e5f-4850-82d9-9d8ca6977168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:34 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Volume f192d154-a57e-4c48-8a21-7c5f22d5cffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc', 'volume_size': 1} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1379185616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f192d154-a57e-4c48-8a21-7c5f22d5cffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6a4deac0314d98884d7a2da67cdc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:34Z,use_quota=True,user_id='6bcf1936d03745e6b4114952afa86655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Creating volume f192d154-a57e-4c48-8a21-7c5f22d5cffc {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:55:34 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:34 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc 1073741824 Jul 24 15:55:34 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:34 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.288s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:34 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Deleted volume successfully. Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b61da297-6bc7-458a-b800-079de8675439 tempest-VolumesSnapshotListTestJSON-1364277204 None] Lock "cinder-6219250d-5898-484b-8506-2a081496d86a-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:34 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc 1073741824" returned: 0 in 0.450s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:34 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc Jul 24 15:55:34 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:35 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc" returned: 0 in 0.255s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:55:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d589e1-5e5f-4850-82d9-9d8ca6977168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4ff514-b51a-4e9c-8a7d-cc8c37958075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:35 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Volume volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc (f192d154-a57e-4c48-8a21-7c5f22d5cffc): created successfully Jul 24 15:55:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b4ff514-b51a-4e9c-8a7d-cc8c37958075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Flow 'volume_create_manager' (bbebc2af-3605-48c8-bfba-57bb163a4a38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:35 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f3777dd5-45fb-4888-b841-8115dce0263b tempest-VolumesSnapshotTestJSON-2066888531 None] Created volume successfully. Jul 24 15:55:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:36 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] Creating offline snapshot 2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 of volume f192d154-a57e-4c48-8a21-7c5f22d5cffc {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:55:36 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8accfde-6093-454e-9c4a-fc9940335861]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:36 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc Jul 24 15:55:36 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:37 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc" returned: 0 in 0.563s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:37 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 1G Jul 24 15:55:37 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-87793c98-f040-4c2f-80d7-3b59c8a77c89 req-72d9cc82-51dd-4287-86e2-7e0f8bf68885 tempest-TestStampPattern-677058618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:37 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 1G" returned: 0 in 0.628s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:37 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 Jul 24 15:55:37 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:38 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5" returned: 0 in 0.308s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:38 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 is being set with open permissions: ugo+rw Jul 24 15:55:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:38 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 Jul 24 15:55:38 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:38 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5" returned: 0 in 0.268s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:38 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.info Jul 24 15:55:38 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:38 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.info" returned: 0 in 0.312s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:38 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.info is being set with open permissions: ugo+rw Jul 24 15:55:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:38 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.info Jul 24 15:55:38 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:39 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.info" returned: 0 in 0.300s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-87793c98-f040-4c2f-80d7-3b59c8a77c89 req-72d9cc82-51dd-4287-86e2-7e0f8bf68885 tempest-TestStampPattern-677058618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.290s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-87793c98-f040-4c2f-80d7-3b59c8a77c89 req-72d9cc82-51dd-4287-86e2-7e0f8bf68885 tempest-TestStampPattern-677058618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:39 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7968f1f3-a2a9-4919-a67e-ca30a027d0f9 tempest-VolumesSnapshotTestJSON-2066888531 None] Create snapshot completed successfully Jul 24 15:55:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-87793c98-f040-4c2f-80d7-3b59c8a77c89 req-72d9cc82-51dd-4287-86e2-7e0f8bf68885 tempest-TestStampPattern-677058618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-f37ae1a9-a180-4f05-8967-abad569a07a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d1a5e1e-d8b2-471c-959b-039c25765cef', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:55:39 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-87793c98-f040-4c2f-80d7-3b59c8a77c89 req-72d9cc82-51dd-4287-86e2-7e0f8bf68885 tempest-TestStampPattern-677058618 None] attachment_update completed successfully. Jul 24 15:55:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:55:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:40 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:55:40 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:55:40 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Flow 'volume_create_manager' (abae2de6-9e32-4126-8225-7f53654aaf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8dd9ca5-9ba4-4725-b9c8-058c00943c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.591s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8dd9ca5-9ba4-4725-b9c8-058c00943c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1332059408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d709f61-b89e-45fe-882b-cd34c001c81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b6a4deac0314d98884d7a2da67cdc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:40Z,use_quota=True,user_id='6bcf1936d03745e6b4114952afa86655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a6f171-76a0-4855-9cb5-366bcb4526e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a6f171-76a0-4855-9cb5-366bcb4526e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09c2415-0796-4e11-9487-1de81f8c56a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09c2415-0796-4e11-9487-1de81f8c56a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4d709f61-b89e-45fe-882b-cd34c001c81b', 'volume_name': 'volume-4d709f61-b89e-45fe-882b-cd34c001c81b', 'volume_size': 1, 'snapshot_id': '2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afc130d-3aff-473f-84c4-f4e01bbfbd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afc130d-3aff-473f-84c4-f4e01bbfbd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35c2588-c9a3-4329-8a00-1e9ccc754185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:40 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Volume 4d709f61-b89e-45fe-882b-cd34c001c81b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4d709f61-b89e-45fe-882b-cd34c001c81b', 'volume_size': 1, 'snapshot_id': '2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5'} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-quobyte-2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5-4d709f61-b89e-45fe-882b-cd34c001c81b" by "_create_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5-4d709f61-b89e-45fe-882b-cd34c001c81b" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Creating volume 4d709f61-b89e-45fe-882b-cd34c001c81b from snapshot 2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 {{(pid=88350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-quobyte-4d709f61-b89e-45fe-882b-cd34c001c81b" by "_copy_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-4d709f61-b89e-45fe-882b-cd34c001c81b" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] snapshot: 2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5, volume: 4d709f61-b89e-45fe-882b-cd34c001c81b, {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4277262e-3802-401b-8608-9fcef9735b52]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:40 devstack sudo[103750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 Jul 24 15:55:40 devstack sudo[103750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:41 devstack sudo[103750]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5" returned: 0 in 0.422s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:55:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:55:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Creating direct copy from snapshot {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:55:41 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a58e4c8-fc89-4400-8c49-7dcdee8d9ec6]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:41 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc Jul 24 15:55:41 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:41 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc" returned: 0 in 0.399s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:41 devstack cinder-volume[88350]: DEBUG cinder.utils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Path /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d709f61-b89e-45fe-882b-cd34c001c81b not found in is_blk_device check {{(pid=88350) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:55:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d709f61-b89e-45fe-882b-cd34c001c81b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:41 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d709f61-b89e-45fe-882b-cd34c001c81b Jul 24 15:55:41 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:46 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:INSERT=31,cinder:UPDATE=118,cinder:SELECT=127,cinder:DELETE=7 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:55:46 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=105,cinder:INSERT=33,cinder:UPDATE=137,cinder:DELETE=16 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:55:46 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-6f17b9e0-737b-4f6b-b6da-d98c15fce711 req-c5a386de-3673-4d7d-aa6d-175df30c53ab tempest-TestStampPattern-677058618 None] Terminate volume connection completed successfully. Jul 24 15:55:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-6f17b9e0-737b-4f6b-b6da-d98c15fce711 req-c5a386de-3673-4d7d-aa6d-175df30c53ab tempest-TestStampPattern-677058618 None] Deleting attachment 4d1a5e1e-d8b2-471c-959b-039c25765cef. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:55:47 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d709f61-b89e-45fe-882b-cd34c001c81b" returned: 0 in 5.805s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:47 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9977522-8f02-47d8-8e6b-9e60d475f1aa]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:47 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc Jul 24 15:55:47 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:48 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc" returned: 0 in 0.591s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Image conversion details: src /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc, size 1024.00 MB, duration 5.81 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d709f61-b89e-45fe-882b-cd34c001c81b {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:55:48 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Converted 1024.00 MB image at 176.38 MB/s Jul 24 15:55:48 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d709f61-b89e-45fe-882b-cd34c001c81b is being set with open permissions: ugo+rw Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d709f61-b89e-45fe-882b-cd34c001c81b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:48 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d709f61-b89e-45fe-882b-cd34c001c81b Jul 24 15:55:48 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:48 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d709f61-b89e-45fe-882b-cd34c001c81b" returned: 0 in 0.259s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-4d709f61-b89e-45fe-882b-cd34c001c81b" released by "_copy_volume_from_snapshot" :: held 7.606s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5-4d709f61-b89e-45fe-882b-cd34c001c81b" released by "_create_volume_from_snapshot" :: held 7.638s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.657s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.413s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] Creating offline snapshot 00756cf1-dfb1-41fb-82e5-ec2dbc68334a of volume f37ae1a9-a180-4f05-8967-abad569a07a6 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35c2588-c9a3-4329-8a00-1e9ccc754185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d709f61-b89e-45fe-882b-cd34c001c81b', 'volume_size': 1, 'snapshot_id': '2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab6ef5e-7ada-49b3-ad07-959f628cc79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0e683d-c3e3-4b64-ab4b-b547dab9519c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:48 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Volume volume-4d709f61-b89e-45fe-882b-cd34c001c81b (4d709f61-b89e-45fe-882b-cd34c001c81b): created successfully Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab6ef5e-7ada-49b3-ad07-959f628cc79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Flow 'volume_create_manager' (abae2de6-9e32-4126-8225-7f53654aaf4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:48 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2f7be82a-0bb5-4039-a910-728a1b257a07 tempest-VolumesSnapshotTestJSON-2066888531 None] Created volume successfully. Jul 24 15:55:48 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 Jul 24 15:55:48 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-4d709f61-b89e-45fe-882b-cd34c001c81b-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-4d709f61-b89e-45fe-882b-cd34c001c81b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-quobyte-4d709f61-b89e-45fe-882b-cd34c001c81b" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-4d709f61-b89e-45fe-882b-cd34c001c81b" acquired by "delete_volume" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b44ac2e-ffe7-41f6-88b5-9d8e179f13ba]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d709f61-b89e-45fe-882b-cd34c001c81b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:48 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6" returned: 0 in 0.456s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:48 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a 1G Jul 24 15:55:48 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:48 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d709f61-b89e-45fe-882b-cd34c001c81b Jul 24 15:55:48 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:49 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d709f61-b89e-45fe-882b-cd34c001c81b" returned: 0 in 0.451s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d709f61-b89e-45fe-882b-cd34c001c81b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:49 devstack sudo[103851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d709f61-b89e-45fe-882b-cd34c001c81b Jul 24 15:55:49 devstack sudo[103851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:49 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a 1G" returned: 0 in 0.601s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f37ae1a9-a180-4f05-8967-abad569a07a6 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:49 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f37ae1a9-a180-4f05-8967-abad569a07a6 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a Jul 24 15:55:49 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:49 devstack sudo[103851]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4d709f61-b89e-45fe-882b-cd34c001c81b" returned: 0 in 0.313s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-4d709f61-b89e-45fe-882b-cd34c001c81b" released by "delete_volume" :: held 0.827s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Created reservations ['a8ef10bd-17e2-4d4e-9aaf-c92773d122a4', '288e58f9-f380-4449-994c-a5e8bd8a90ec', '56cbf5b4-450d-4776-a081-a064d2f50fb4', '5a73d50c-161e-49e1-bec0-46c9fab856a5'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:49 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:55:49 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:49 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f37ae1a9-a180-4f05-8967-abad569a07a6 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a" returned: 0 in 0.378s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:49 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a is being set with open permissions: ugo+rw Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:49 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a Jul 24 15:55:49 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:49 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-quobyte-f192d154-a57e-4c48-8a21-7c5f22d5cffc" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-f192d154-a57e-4c48-8a21-7c5f22d5cffc" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-quobyte-2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Deleting offline snapshot 2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 of volume f192d154-a57e-4c48-8a21-7c5f22d5cffc {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] snapshot_file for this snap is: volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:55:50 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a" returned: 0 in 0.293s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e41e61-db69-480c-9546-6ed62f8be487]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:50 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.405s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:50 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Deleted volume successfully. Jul 24 15:55:50 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.info Jul 24 15:55:50 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-44e7a81a-9ffb-4189-b438-b41d0001ea39 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-4d709f61-b89e-45fe-882b-cd34c001c81b-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:50 devstack sudo[103865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 Jul 24 15:55:50 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:50 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.info" returned: 0 in 0.318s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:50 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.info is being set with open permissions: ugo+rw Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:50 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5" returned: 0 in 0.404s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:55:50 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.info Jul 24 15:55:50 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b990ae-9a12-4c01-bd89-a2c35daa384e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:50 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc Jul 24 15:55:50 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:50 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.info" returned: 0 in 0.281s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.486s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:50 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d73e1c58-356e-4d47-a40f-ef63f21173df tempest-TestStampPattern-677058618 None] Create snapshot completed successfully Jul 24 15:55:50 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc" returned: 0 in 0.397s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:50 devstack sudo[103883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 Jul 24 15:55:50 devstack sudo[103883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:51 devstack sudo[103883]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5" returned: 0 in 0.387s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:51 devstack sudo[103889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5 Jul 24 15:55:51 devstack sudo[103889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:51 devstack sudo[103889]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc.2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5" returned: 0 in 0.358s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5" released by "_delete_snapshot" :: held 1.717s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-f192d154-a57e-4c48-8a21-7c5f22d5cffc" released by "delete_snapshot" :: held 1.750s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:51 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Created reservations ['f0b26b7e-db16-4918-8529-86e3c4e53c64', 'db4c9d20-621c-4cd3-88de-d224b5c3abd6', '99f8adf4-1399-43db-99f7-d4f286d82da9', 'f4713647-9169-4911-b400-4d00382a2478'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:51 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Delete snapshot completed successfully. Jul 24 15:55:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cd33c29d-3909-4169-9c66-4ceeae1ab9c4 tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-2578b6ca-0442-4d9c-8cc0-21f2d8ab9db5-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-f192d154-a57e-4c48-8a21-7c5f22d5cffc-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-f192d154-a57e-4c48-8a21-7c5f22d5cffc-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-quobyte-f192d154-a57e-4c48-8a21-7c5f22d5cffc" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-f192d154-a57e-4c48-8a21-7c5f22d5cffc" acquired by "delete_volume" :: waited 0.035s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:52 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c1ce68-de81-42ac-bfb7-03a61f78e451]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:52 devstack sudo[103892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc Jul 24 15:55:52 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:53 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc" returned: 0 in 0.492s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:53 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc Jul 24 15:55:53 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:53 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f192d154-a57e-4c48-8a21-7c5f22d5cffc" returned: 0 in 0.296s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-f192d154-a57e-4c48-8a21-7c5f22d5cffc" released by "delete_volume" :: held 0.883s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:53 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Created reservations ['56ef5507-9058-4ab6-aab1-4a9cb9dba30b', 'a3a4c820-9676-4d13-acc9-87b6b82f6573', '3b9a5e94-338a-4959-855d-c65c597cf2c6', 'be4a22d6-f254-4b09-aa71-ef62e7a1779e'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:53 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:55:53 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:53 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.274s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:53 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:53 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Deleted volume successfully. Jul 24 15:55:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-721881c9-1907-449d-b583-a0973fb1246c tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-f192d154-a57e-4c48-8a21-7c5f22d5cffc-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-9ecc0016-72db-41eb-b58e-471e6f76a212-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-9ecc0016-72db-41eb-b58e-471e6f76a212-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "cinder-quobyte-9ecc0016-72db-41eb-b58e-471e6f76a212" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-9ecc0016-72db-41eb-b58e-471e6f76a212" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:54 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1a158a-430d-476e-9093-6f3e8d22caba]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:55 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212 Jul 24 15:55:55 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:55 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212" returned: 0 in 0.435s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:55 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212 Jul 24 15:55:55 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:55 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9ecc0016-72db-41eb-b58e-471e6f76a212" returned: 0 in 0.288s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-quobyte-9ecc0016-72db-41eb-b58e-471e6f76a212" released by "delete_volume" :: held 0.800s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:55 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Created reservations ['92fdad0a-b3d2-43af-8250-3ea4e0a16258', '80019930-7273-44da-b9bd-98bc5c1915b8', '1ccc44b0-5bb3-486d-a4cd-37cfdcc0f0eb', 'cf54ebd1-2629-4d49-b218-2e5b3dba1a26'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:55:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:55 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:55:55 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:55:56 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Jul 24 15:55:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.322s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:55:56 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:55:56 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Deleted volume successfully. Jul 24 15:55:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62915bd3-30c6-42e0-97af-4d9f839bd51c tempest-VolumesSnapshotTestJSON-2066888531 None] Lock "cinder-9ecc0016-72db-41eb-b58e-471e6f76a212-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Flow 'volume_create_manager' (42afd7df-0b1e-4683-a920-e398c0dc179b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3346ea5-52e1-4d0e-b60a-37fd56da42a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3346ea5-52e1-4d0e-b60a-37fd56da42a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-702984580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b54106-8853-45e4-91c3-27b7cb8a2b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95897595987f4ae98b05e3980d3c5d9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=00756cf1-dfb1-41fb-82e5-ec2dbc68334a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:55:59Z,use_quota=True,user_id='6f668d051d204bd0bd055f43db155ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dda3c3b-f7f2-4740-948a-249dffb1cdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dda3c3b-f7f2-4740-948a-249dffb1cdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee49e0f-c414-4799-862c-dd0da0be736f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee49e0f-c414-4799-862c-dd0da0be736f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c2b54106-8853-45e4-91c3-27b7cb8a2b98', 'volume_name': 'volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98', 'volume_size': 1, 'snapshot_id': '00756cf1-dfb1-41fb-82e5-ec2dbc68334a'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178b99d8-d1ce-45ab-aeaf-d785601fd924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (178b99d8-d1ce-45ab-aeaf-d785601fd924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aadd480-ee88-422f-8bd1-e6563d404310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:55:59 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Volume c2b54106-8853-45e4-91c3-27b7cb8a2b98: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98', 'volume_size': 1, 'snapshot_id': '00756cf1-dfb1-41fb-82e5-ec2dbc68334a'} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Acquiring lock "cinder-quobyte-00756cf1-dfb1-41fb-82e5-ec2dbc68334a-c2b54106-8853-45e4-91c3-27b7cb8a2b98" by "_create_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Lock "cinder-quobyte-00756cf1-dfb1-41fb-82e5-ec2dbc68334a-c2b54106-8853-45e4-91c3-27b7cb8a2b98" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Creating volume c2b54106-8853-45e4-91c3-27b7cb8a2b98 from snapshot 00756cf1-dfb1-41fb-82e5-ec2dbc68334a {{(pid=88350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Acquiring lock "cinder-quobyte-c2b54106-8853-45e4-91c3-27b7cb8a2b98" by "_copy_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Lock "cinder-quobyte-c2b54106-8853-45e4-91c3-27b7cb8a2b98" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] snapshot: 00756cf1-dfb1-41fb-82e5-ec2dbc68334a, volume: c2b54106-8853-45e4-91c3-27b7cb8a2b98, {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a275a9-f4a7-4348-b605-20ab20348402]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:55:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:55:59 devstack sudo[103946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a Jul 24 15:55:59 devstack sudo[103946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:00 devstack sudo[103946]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a" returned: 0 in 0.411s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f37ae1a9-a180-4f05-8967-abad569a07a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:56:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:56:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Creating direct copy from snapshot {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:56:00 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[617d1499-fe81-4c0c-9c9a-900da646fe1d]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:00 devstack sudo[103951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 Jul 24 15:56:00 devstack sudo[103951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:00 devstack sudo[103951]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6" returned: 0 in 0.414s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:00 devstack cinder-volume[88350]: DEBUG cinder.utils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Path /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98 not found in is_blk_device check {{(pid=88350) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:56:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:00 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98 Jul 24 15:56:00 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:06 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98" returned: 0 in 6.142s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:06 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ac0891-d53f-4339-b7e0-f2395a328416]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:07 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 Jul 24 15:56:07 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:07 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6" returned: 0 in 0.809s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:07 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Image conversion details: src /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98 {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:56:07 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Converted 1024.00 MB image at 166.66 MB/s Jul 24 15:56:07 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98 is being set with open permissions: ugo+rw Jul 24 15:56:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:07 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98 Jul 24 15:56:07 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:08 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98" returned: 0 in 0.380s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Lock "cinder-quobyte-c2b54106-8853-45e4-91c3-27b7cb8a2b98" released by "_copy_volume_from_snapshot" :: held 8.285s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:56:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Lock "cinder-quobyte-00756cf1-dfb1-41fb-82e5-ec2dbc68334a-c2b54106-8853-45e4-91c3-27b7cb8a2b98" released by "_create_volume_from_snapshot" :: held 8.354s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:56:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.391s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aadd480-ee88-422f-8bd1-e6563d404310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98', 'volume_size': 1, 'snapshot_id': '00756cf1-dfb1-41fb-82e5-ec2dbc68334a'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4326b9-e002-4d5d-895a-f6e230c712d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:08 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Volume volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98 (c2b54106-8853-45e4-91c3-27b7cb8a2b98): created successfully Jul 24 15:56:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb4326b9-e002-4d5d-895a-f6e230c712d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Flow 'volume_create_manager' (42afd7df-0b1e-4683-a920-e398c0dc179b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:56:08 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-db238397-39d9-423d-a1cd-b70e77fdb999 tempest-TestStampPattern-677058618 None] Created volume successfully. Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Flow 'volume_create_manager' (2e82df2e-397f-4efc-be09-523d6b63b12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ab6813-3182-4b26-8618-cb79602a0bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ab6813-3182-4b26-8618-cb79602a0bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1357056260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c4d4aa-1d60-4999-8130-3a4cd28b2f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5957e5d7db4a759e6d2ad5d086b8e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:56:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:56:12Z,use_quota=True,user_id='e7a1e3faeb8d46f8ba9e21b159af7167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9091b21-f719-47ae-a4a7-40a8d4792026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9091b21-f719-47ae-a4a7-40a8d4792026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7a8268-0c42-4b29-a00d-24fb26811994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b7a8268-0c42-4b29-a00d-24fb26811994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6c4d4aa-1d60-4999-8130-3a4cd28b2f51', 'volume_name': 'volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51', 'volume_size': 2}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c309868-136a-45c5-8718-dfd2996423db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c309868-136a-45c5-8718-dfd2996423db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44937e7-6e78-4685-9979-a3aef8364855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:11 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Volume c6c4d4aa-1d60-4999-8130-3a4cd28b2f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51', 'volume_size': 2} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1357056260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6c4d4aa-1d60-4999-8130-3a4cd28b2f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d5957e5d7db4a759e6d2ad5d086b8e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:56:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:56:12Z,use_quota=True,user_id='e7a1e3faeb8d46f8ba9e21b159af7167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Creating volume c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:56:11 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:56:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 2147483648 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:11 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 2147483648 Jul 24 15:56:11 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:12 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 2147483648" returned: 0 in 0.739s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:12 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 Jul 24 15:56:12 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:12 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51" returned: 0 in 0.405s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:56:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44937e7-6e78-4685-9979-a3aef8364855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51', 'volume_size': 2}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b92d82-1675-41cb-9fa7-d40325f4fdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:12 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Volume volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 (c6c4d4aa-1d60-4999-8130-3a4cd28b2f51): created successfully Jul 24 15:56:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2b92d82-1675-41cb-9fa7-d40325f4fdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Flow 'volume_create_manager' (2e82df2e-397f-4efc-be09-523d6b63b12f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:56:13 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7d2121a0-49d3-4183-a435-a1570c870ff6 tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Created volume successfully. Jul 24 15:56:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Creating offline snapshot ca910ecf-63f2-43e1-b7cc-d449222d523e of volume c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:56:14 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8c0cc1-e22f-469c-9394-412a205b5d2f]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:14 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 Jul 24 15:56:14 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:14 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51" returned: 0 in 0.502s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e 2G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:14 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e 2G Jul 24 15:56:14 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:15 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e 2G" returned: 0 in 0.735s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:15 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e Jul 24 15:56:15 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:15 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e" returned: 0 in 0.428s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:15 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e is being set with open permissions: ugo+rw Jul 24 15:56:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:15 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e Jul 24 15:56:15 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:16 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e" returned: 0 in 0.398s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:16 devstack sudo[104140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.info Jul 24 15:56:16 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:16 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.info" returned: 0 in 0.746s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:17 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.info is being set with open permissions: ugo+rw Jul 24 15:56:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:17 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.info Jul 24 15:56:17 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:17 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.info" returned: 0 in 0.616s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.611s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:17 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-ae81edb4-b9dd-4d3f-9dfe-52fef373e30f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Create snapshot completed successfully Jul 24 15:56:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Acquiring lock "cinder-ca910ecf-63f2-43e1-b7cc-d449222d523e-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:56:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "cinder-ca910ecf-63f2-43e1-b7cc-d449222d523e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:56:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Acquiring lock "cinder-quobyte-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:56:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "cinder-quobyte-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51" acquired by "delete_snapshot" :: waited 0.039s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:56:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Acquiring lock "cinder-quobyte-ca910ecf-63f2-43e1-b7cc-d449222d523e" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:56:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "cinder-quobyte-ca910ecf-63f2-43e1-b7cc-d449222d523e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:56:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Deleting offline snapshot ca910ecf-63f2-43e1-b7cc-d449222d523e of volume c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:56:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] snapshot_file for this snap is: volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:56:18 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[47974b73-bbb6-4fea-ae2e-1c60c7534385]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:18 devstack sudo[104163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e Jul 24 15:56:18 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:19 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e" returned: 0 in 0.552s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:56:19 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1144ad7-601e-4a8b-892c-da345e0d034a]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:19 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 Jul 24 15:56:19 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:19 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51" returned: 0 in 0.504s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:19 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e Jul 24 15:56:19 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:20 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e" returned: 0 in 0.889s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:20 devstack sudo[104210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e Jul 24 15:56:20 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:21 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51.ca910ecf-63f2-43e1-b7cc-d449222d523e" returned: 0 in 0.632s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "cinder-quobyte-ca910ecf-63f2-43e1-b7cc-d449222d523e" released by "_delete_snapshot" :: held 2.809s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:56:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "cinder-quobyte-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51" released by "delete_snapshot" :: held 2.856s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:56:21 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Created reservations ['4e9aff0d-3668-4ead-89da-09a3b64aac57', '357e30b7-788b-4353-986b-0aaf113f1dba', '29a2c5f2-3a77-41e3-b38f-131c8f824c09', 'dd76df87-5bea-4934-a606-a5327d6b9582'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:56:21 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Delete snapshot completed successfully. Jul 24 15:56:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03f53bec-5028-4344-a7f3-e4f96dcddb3c tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "cinder-ca910ecf-63f2-43e1-b7cc-d449222d523e-delete_snapshot" released by "delete_snapshot" :: held 3.161s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:56:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Acquiring lock "cinder-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:56:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "cinder-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:56:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Acquiring lock "cinder-quobyte-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:56:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "cinder-quobyte-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51" acquired by "delete_volume" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:56:22 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b18f71b-a3c0-4669-a3cf-74b11e2ed3dd]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:22 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 Jul 24 15:56:22 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:22 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51" returned: 0 in 0.542s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:22 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51 Jul 24 15:56:22 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:22 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51" returned: 0 in 0.276s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "cinder-quobyte-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51" released by "delete_volume" :: held 0.907s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:56:23 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Created reservations ['a82717c4-a421-4664-bdaa-7cc432646739', '9a16e077-9eb9-4c28-a3a8-5b9bdba21787', 'c78a6dcf-e474-4891-81ec-90876daa7b21', '0fd1dc9a-f849-4fe5-a576-d3bc3daf9c90'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:56:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:56:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:56:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:23 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:56:23 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:23 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.328s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:23 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:56:23 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Deleted volume successfully. Jul 24 15:56:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f13920c7-027e-463d-b31b-47047984e52f tempest-VolumesSnapshotNegativeTestJSON-1353032466 None] Lock "cinder-c6c4d4aa-1d60-4999-8130-3a4cd28b2f51-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:56:33 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=41,cinder:UPDATE=56,cinder:INSERT=11,cinder:DELETE=4 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:56:33 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=45,cinder:UPDATE=49,cinder:DELETE=5,cinder:INSERT=16 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:56:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:56:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:56:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:56:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:40 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:56:40 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:40 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.486s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:56:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:56:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:56:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:56:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-cfef5748-99a5-4933-956b-75da108f60c4 req-395fd575-9c22-4e70-8ba7-c9a8c723c575 tempest-TestStampPattern-677058618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-cfef5748-99a5-4933-956b-75da108f60c4 req-395fd575-9c22-4e70-8ba7-c9a8c723c575 tempest-TestStampPattern-677058618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:43 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f24c157-1e96-4ccd-8432-6cb616bd02ce]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-cfef5748-99a5-4933-956b-75da108f60c4 req-395fd575-9c22-4e70-8ba7-c9a8c723c575 tempest-TestStampPattern-677058618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:43 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98 Jul 24 15:56:43 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:44 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-cfef5748-99a5-4933-956b-75da108f60c4 req-395fd575-9c22-4e70-8ba7-c9a8c723c575 tempest-TestStampPattern-677058618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98" returned: 0 in 0.446s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-cfef5748-99a5-4933-956b-75da108f60c4 req-395fd575-9c22-4e70-8ba7-c9a8c723c575 tempest-TestStampPattern-677058618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.486s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:44 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-cfef5748-99a5-4933-956b-75da108f60c4 req-395fd575-9c22-4e70-8ba7-c9a8c723c575 tempest-TestStampPattern-677058618 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9496103d-8454-44e3-b1f2-ef1dfa650880', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:56:44 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-cfef5748-99a5-4933-956b-75da108f60c4 req-395fd575-9c22-4e70-8ba7-c9a8c723c575 tempest-TestStampPattern-677058618 None] attachment_update completed successfully. Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Flow 'volume_create_manager' (b3cdecf1-4eef-4e01-afac-be85d107f217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901a114d-f141-4f47-9abe-61a85e6db302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:48 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-88527518-9ae3-4bd8-b12f-a0ecf7313f68 req-c16140ba-12cb-41a8-9d0c-267902976849 tempest-TestStampPattern-677058618 None] Terminate volume connection completed successfully. Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-88527518-9ae3-4bd8-b12f-a0ecf7313f68 req-c16140ba-12cb-41a8-9d0c-267902976849 tempest-TestStampPattern-677058618 None] Deleting attachment 9496103d-8454-44e3-b1f2-ef1dfa650880. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901a114d-f141-4f47-9abe-61a85e6db302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1911954128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19eb76cd-f8cd-475d-aced-6e026333a78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e7b53bf04d4e97b618495f4c5392c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:56:49Z,use_quota=True,user_id='2e69c01d195247628fc9ed299f2b03e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baec8d10-7118-4bde-8b2e-4c3890aba887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baec8d10-7118-4bde-8b2e-4c3890aba887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d634cd-fb8d-497c-a610-385b65135a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83d634cd-fb8d-497c-a610-385b65135a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19eb76cd-f8cd-475d-aced-6e026333a78b', 'volume_name': 'volume-19eb76cd-f8cd-475d-aced-6e026333a78b', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b87b26-b98c-4694-809c-e286f05dfe15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b87b26-b98c-4694-809c-e286f05dfe15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3feee962-c46a-4cb7-9e02-99259f2ac686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:48 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Volume 19eb76cd-f8cd-475d-aced-6e026333a78b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19eb76cd-f8cd-475d-aced-6e026333a78b', 'volume_size': 1} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:56:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1911954128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19eb76cd-f8cd-475d-aced-6e026333a78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e7b53bf04d4e97b618495f4c5392c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:56:49Z,use_quota=True,user_id='2e69c01d195247628fc9ed299f2b03e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Creating volume 19eb76cd-f8cd-475d-aced-6e026333a78b {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:56:48 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:56:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-19eb76cd-f8cd-475d-aced-6e026333a78b 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:48 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-19eb76cd-f8cd-475d-aced-6e026333a78b 1073741824 Jul 24 15:56:48 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:49 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-19eb76cd-f8cd-475d-aced-6e026333a78b 1073741824" returned: 0 in 0.505s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-19eb76cd-f8cd-475d-aced-6e026333a78b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:49 devstack sudo[104813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-19eb76cd-f8cd-475d-aced-6e026333a78b Jul 24 15:56:49 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:49 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-19eb76cd-f8cd-475d-aced-6e026333a78b" returned: 0 in 0.279s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:56:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3feee962-c46a-4cb7-9e02-99259f2ac686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19eb76cd-f8cd-475d-aced-6e026333a78b', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad50299-ffc1-4d21-9630-09e3919460df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:49 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Volume volume-19eb76cd-f8cd-475d-aced-6e026333a78b (19eb76cd-f8cd-475d-aced-6e026333a78b): created successfully Jul 24 15:56:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ad50299-ffc1-4d21-9630-09e3919460df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Flow 'volume_create_manager' (b3cdecf1-4eef-4e01-afac-be85d107f217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:56:49 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-4b4efa05-4758-42b2-848c-1d41135ca728 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Created volume successfully. Jul 24 15:56:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-f02b2a8c-2398-4125-b2f6-b85398b08e78 req-79fe2572-e487-4788-a0aa-c17563eb1e87 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-f02b2a8c-2398-4125-b2f6-b85398b08e78 req-79fe2572-e487-4788-a0aa-c17563eb1e87 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-f02b2a8c-2398-4125-b2f6-b85398b08e78 req-79fe2572-e487-4788-a0aa-c17563eb1e87 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-f02b2a8c-2398-4125-b2f6-b85398b08e78 req-79fe2572-e487-4788-a0aa-c17563eb1e87 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-19eb76cd-f8cd-475d-aced-6e026333a78b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1f4c5607-6a9b-4135-8116-fada13827681', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:56:52 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-f02b2a8c-2398-4125-b2f6-b85398b08e78 req-79fe2572-e487-4788-a0aa-c17563eb1e87 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] attachment_update completed successfully. Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Acquiring lock "cinder-c2b54106-8853-45e4-91c3-27b7cb8a2b98-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Lock "cinder-c2b54106-8853-45e4-91c3-27b7cb8a2b98-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Acquiring lock "cinder-quobyte-c2b54106-8853-45e4-91c3-27b7cb8a2b98" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Lock "cinder-quobyte-c2b54106-8853-45e4-91c3-27b7cb8a2b98" acquired by "delete_volume" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1261ef6b-68e3-4e67-a758-2e103ae34507]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:53 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98 Jul 24 15:56:53 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Flow 'volume_create_manager' (44b82dc9-c80d-4ca0-a4c0-1906c64f6026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1804d8e0-802f-4638-91cd-275ce736064b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1804d8e0-802f-4638-91cd-275ce736064b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-304316053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dda867f-b49f-4f1f-84c6-7240de6d5978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c8e01881e647119d77f5238762d8db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:56:54Z,use_quota=True,user_id='9b4f6237a73d498b870dfe227a4bffc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edf62fc-3279-4d3b-ac82-1b9154adb5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edf62fc-3279-4d3b-ac82-1b9154adb5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ef4fe4-87c9-4d4f-b995-fa50c7510b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG cinder.image.glance [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Creating Keystone auth plugin from conf {{(pid=88350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:56:53 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98" returned: 0 in 0.398s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:53 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98 Jul 24 15:56:53 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ef4fe4-87c9-4d4f-b995-fa50c7510b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6dda867f-b49f-4f1f-84c6-7240de6d5978', 'volume_name': 'volume-6dda867f-b49f-4f1f-84c6-7240de6d5978', 'volume_size': 1, 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'df66204cc96f42be98c9c3c0564f8276', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'created_at': datetime.datetime(2026, 7, 24, 13, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f012ce-06a2-4881-9fa6-4ca43ad42ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38f012ce-06a2-4881-9fa6-4ca43ad42ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3a0950-bc44-4178-aeb0-a71450c85e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:56:54 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Volume 6dda867f-b49f-4f1f-84c6-7240de6d5978: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6dda867f-b49f-4f1f-84c6-7240de6d5978', 'volume_size': 1, 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'df66204cc96f42be98c9c3c0564f8276', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'created_at': datetime.datetime(2026, 7, 24, 13, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Trying to clone 6dda867f-b49f-4f1f-84c6-7240de6d5978 from image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]). {{(pid=88350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:56:54 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c2b54106-8853-45e4-91c3-27b7cb8a2b98" returned: 0 in 0.277s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Lock "cinder-quobyte-c2b54106-8853-45e4-91c3-27b7cb8a2b98" released by "delete_volume" :: held 0.735s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Created reservations ['2c4ff148-51c6-4024-894b-f8b850a13f95', 'b1949a42-12a3-4076-b716-1680af262f36', '8c51ec57-3001-4d57-8f0b-1952b53b4735', '7367de4f-660d-47e3-9c68-819db27e3243'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_fx_ousgadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:56:54 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Image download 20.69 MB at 20.69 MB/s Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eb938f-c8f6-4217-a3b6-b5b19691ae8c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_fx_ousgadevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:54 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:56:54 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:54 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_fx_ousgadevstack@QuobyteHD Jul 24 15:56:54 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.362s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:56:54 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:54 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Deleted volume successfully. Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2e48acc5-8611-40b2-88f4-887af452d597 tempest-TestStampPattern-677058618 None] Lock "cinder-c2b54106-8853-45e4-91c3-27b7cb8a2b98-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:56:54 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Acquiring lock "cinder-00756cf1-dfb1-41fb-82e5-ec2dbc68334a-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_fx_ousgadevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Temporary image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 is fetched for user 9b4f6237a73d498b870dfe227a4bffc0. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Lock "cinder-00756cf1-dfb1-41fb-82e5-ec2dbc68334a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Acquiring lock "cinder-quobyte-f37ae1a9-a180-4f05-8967-abad569a07a6" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Lock "cinder-quobyte-f37ae1a9-a180-4f05-8967-abad569a07a6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Acquiring lock "cinder-quobyte-00756cf1-dfb1-41fb-82e5-ec2dbc68334a" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Lock "cinder-quobyte-00756cf1-dfb1-41fb-82e5-ec2dbc68334a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Deleting offline snapshot 00756cf1-dfb1-41fb-82e5-ec2dbc68334a of volume f37ae1a9-a180-4f05-8967-abad569a07a6 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] snapshot_file for this snap is: volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[aada6170-8ae5-4109-bc8e-6ac23c8eac1d]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb42319-0817-48bd-a9f7-b120288f37b4]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_fx_ousgadevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:55 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a Jul 24 15:56:55 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:55 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_fx_ousgadevstack@QuobyteHD Jul 24 15:56:55 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:55 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_fx_ousgadevstack@QuobyteHD" returned: 0 in 0.390s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-304316053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dda867f-b49f-4f1f-84c6-7240de6d5978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c8e01881e647119d77f5238762d8db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:56:54Z,use_quota=True,user_id='9b4f6237a73d498b870dfe227a4bffc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Creating volume 6dda867f-b49f-4f1f-84c6-7240de6d5978 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:56:55 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:55 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a" returned: 0 in 0.452s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f37ae1a9-a180-4f05-8967-abad569a07a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:56:55 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 1073741824 Jul 24 15:56:55 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[121d5719-229c-498c-afb7-3ff0eb33130c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:55 devstack sudo[105275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 Jul 24 15:56:55 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:55 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-5de916f7-92b6-4393-af6a-59c0187d00af req-eb8f97cd-85a0-4c74-81ac-a727d3f32c82 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Terminate volume connection completed successfully. Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-5de916f7-92b6-4393-af6a-59c0187d00af req-eb8f97cd-85a0-4c74-81ac-a727d3f32c82 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Deleting attachment 1f4c5607-6a9b-4135-8116-fada13827681. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:56:55 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6" returned: 0 in 0.486s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:55 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 1073741824" returned: 0 in 0.569s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:55 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a Jul 24 15:56:55 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:56 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 Jul 24 15:56:56 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:56 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978" returned: 0 in 0.258s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Attempting download of 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}])) to volume 6dda867f-b49f-4f1f-84c6-7240de6d5978. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:56:56 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a" returned: 0 in 0.375s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:56 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a Jul 24 15:56:56 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7943003-6199-4c05-95fe-49795b77fbdb]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_8ak9f4h3 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Acquiring lock "cinder-19eb76cd-f8cd-475d-aced-6e026333a78b-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:56:56 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_8ak9f4h3 Jul 24 15:56:56 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Lock "cinder-19eb76cd-f8cd-475d-aced-6e026333a78b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Acquiring lock "cinder-quobyte-19eb76cd-f8cd-475d-aced-6e026333a78b" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Lock "cinder-quobyte-19eb76cd-f8cd-475d-aced-6e026333a78b" acquired by "delete_volume" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4518b10-6d3b-46d4-938c-90157670e4bf]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-19eb76cd-f8cd-475d-aced-6e026333a78b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:56 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6.00756cf1-dfb1-41fb-82e5-ec2dbc68334a" returned: 0 in 0.294s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Lock "cinder-quobyte-00756cf1-dfb1-41fb-82e5-ec2dbc68334a" released by "_delete_snapshot" :: held 1.741s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Lock "cinder-quobyte-f37ae1a9-a180-4f05-8967-abad569a07a6" released by "delete_snapshot" :: held 1.773s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:56:56 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-19eb76cd-f8cd-475d-aced-6e026333a78b Jul 24 15:56:56 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Created reservations ['c2b41595-327f-4ee4-bc0d-06e5c69c5c74', '99ff6341-f0b5-4951-a684-cf39eba19661', 'e672922b-8349-4a4c-b560-5db6797b2e54', '1b19c89d-5045-4604-b676-6cc8edef0501'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:56:56 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_8ak9f4h3" returned: 0 in 0.398s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_8ak9f4h3 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:56 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Delete snapshot completed successfully. Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-94386210-ef78-414d-b45b-ca74c3a0ecdd tempest-TestStampPattern-677058618 None] Lock "cinder-00756cf1-dfb1-41fb-82e5-ec2dbc68334a-delete_snapshot" released by "delete_snapshot" :: held 1.950s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:56:56 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_8ak9f4h3 Jul 24 15:56:56 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:56 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-19eb76cd-f8cd-475d-aced-6e026333a78b" returned: 0 in 0.392s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-19eb76cd-f8cd-475d-aced-6e026333a78b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:57 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-19eb76cd-f8cd-475d-aced-6e026333a78b Jul 24 15:56:57 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:57 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_8ak9f4h3" returned: 1 in 0.371s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_8ak9f4h3' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a67f0c-5e0b-488b-96fd-ac282b7e7df1]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_fx_ousgadevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:57 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-19eb76cd-f8cd-475d-aced-6e026333a78b" returned: 0 in 0.251s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:57 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_fx_ousgadevstack@QuobyteHD Jul 24 15:56:57 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Lock "cinder-quobyte-19eb76cd-f8cd-475d-aced-6e026333a78b" released by "delete_volume" :: held 0.704s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Created reservations ['dbd91077-fe37-4d05-99a4-bf0a8b1ef4ed', '9309bd10-27fa-4077-8517-cf6f12611752', '1ce6333b-3114-4a7d-9e0b-e2017e316751', '736ff6f7-34f9-42d1-bcc1-bab19316ec9d'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:57 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:56:57 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:57 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_fx_ousgadevstack@QuobyteHD" returned: 0 in 0.335s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 was qcow2, converting to qcow2 {{(pid=88350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_fx_ousgadevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:56:57 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_fx_ousgadevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 Jul 24 15:56:57 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:56:57 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.275s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:56:57 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Deleted volume successfully. Jul 24 15:56:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e269de82-c73b-4a67-86b7-9057dea19c75 tempest-TestServerVolumeAttachScenarioOldVersion-1800777640 None] Lock "cinder-19eb76cd-f8cd-475d-aced-6e026333a78b-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:00 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_fx_ousgadevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978" returned: 0 in 2.727s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:00 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4_fx_ousgadevstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:57:00 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Converted 112.00 MB image at 41.06 MB/s Jul 24 15:57:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:00 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 1G Jul 24 15:57:00 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:00 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 1G" returned: 0 in 0.473s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:00 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Downloaded image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 ((None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}])) to volume 6dda867f-b49f-4f1f-84c6-7240de6d5978 successfully. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:57:00 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Temporary image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 for user 9b4f6237a73d498b870dfe227a4bffc0 is deleted. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:57:00 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Marking volume 6dda867f-b49f-4f1f-84c6-7240de6d5978 as bootable. {{(pid=88350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:57:00 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Copying metadata from image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 to 6dda867f-b49f-4f1f-84c6-7240de6d5978. {{(pid=88350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:57:00 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Creating volume glance metadata for volume 6dda867f-b49f-4f1f-84c6-7240de6d5978 backed by image 4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:57:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3a0950-bc44-4178-aeb0-a71450c85e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dda867f-b49f-4f1f-84c6-7240de6d5978', 'volume_size': 1, 'image_id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'df66204cc96f42be98c9c3c0564f8276', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4', 'created_at': datetime.datetime(2026, 7, 24, 13, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4e0e41df-1cff-4c2a-a6b0-fb9f8c2df6c4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b04ab1e-7e47-4160-9c2b-ede24183ef4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:00 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Volume volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 (6dda867f-b49f-4f1f-84c6-7240de6d5978): created successfully Jul 24 15:57:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b04ab1e-7e47-4160-9c2b-ede24183ef4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Flow 'volume_create_manager' (44b82dc9-c80d-4ca0-a4c0-1906c64f6026) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:00 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3785ceeb-8fdb-430c-b650-c1a48cb23b8e tempest-TestShelveInstance-1237774801 None] Created volume successfully. Jul 24 15:57:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Acquiring lock "cinder-f37ae1a9-a180-4f05-8967-abad569a07a6-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Lock "cinder-f37ae1a9-a180-4f05-8967-abad569a07a6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Acquiring lock "cinder-quobyte-f37ae1a9-a180-4f05-8967-abad569a07a6" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Lock "cinder-quobyte-f37ae1a9-a180-4f05-8967-abad569a07a6" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:02 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd04b7e-fd68-4d34-9e2b-237eb33fdad5]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:02 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 Jul 24 15:57:02 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:02 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6" returned: 0 in 0.485s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:02 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6 Jul 24 15:57:02 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:02 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f37ae1a9-a180-4f05-8967-abad569a07a6" returned: 0 in 0.309s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Lock "cinder-quobyte-f37ae1a9-a180-4f05-8967-abad569a07a6" released by "delete_volume" :: held 0.886s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:03 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Created reservations ['a0a38263-f7af-44ee-a056-444d3aebb5e2', 'f89d1971-2fe4-4c15-a7d3-49cc8aace8b2', '8a2d4734-fb67-41ea-a9c9-26e352766b08', '31e4ec84-fbe8-4ef8-b407-8a7f952a2c8e'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:03 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:57:03 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:03 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.329s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:03 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:03 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Deleted volume successfully. Jul 24 15:57:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2df94357-4bf1-4ec8-a8b5-8c256cd2dc2e tempest-TestStampPattern-677058618 None] Lock "cinder-f37ae1a9-a180-4f05-8967-abad569a07a6-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-158e5499-b526-4583-bc79-d63b4504c6c9 req-af8dccf0-6f46-47ae-a3b5-40140e198e9f tempest-TestShelveInstance-1237774801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-158e5499-b526-4583-bc79-d63b4504c6c9 req-af8dccf0-6f46-47ae-a3b5-40140e198e9f tempest-TestShelveInstance-1237774801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-158e5499-b526-4583-bc79-d63b4504c6c9 req-af8dccf0-6f46-47ae-a3b5-40140e198e9f tempest-TestShelveInstance-1237774801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-158e5499-b526-4583-bc79-d63b4504c6c9 req-af8dccf0-6f46-47ae-a3b5-40140e198e9f tempest-TestShelveInstance-1237774801 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-6dda867f-b49f-4f1f-84c6-7240de6d5978', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e3de9b29-9e44-46a3-bcb8-688324fdd35b', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:57:04 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-158e5499-b526-4583-bc79-d63b4504c6c9 req-af8dccf0-6f46-47ae-a3b5-40140e198e9f tempest-TestShelveInstance-1237774801 None] attachment_update completed successfully. Jul 24 15:57:14 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=62,cinder:UPDATE=38,cinder:INSERT=11,cinder:DELETE=2 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:57:14 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=45,cinder:UPDATE=45,cinder:INSERT=20,cinder:DELETE=3 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Flow 'volume_create_manager' (d98b3728-71ba-4f88-8821-177bf4d75f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5289c7ea-6927-4094-a386-c8c5359319c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5289c7ea-6927-4094-a386-c8c5359319c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-56600211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b725c51-1f1e-4c04-ab3f-04a44e76cda8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ade64f2b1245fc8d8321dad28061d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:20Z,use_quota=True,user_id='ef93b3e88b3644e2a143f87acc1cd6df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1634096-2db4-474b-a12e-6b98b056433e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1634096-2db4-474b-a12e-6b98b056433e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92b6c8a-d0df-4b9a-9864-7c2f7514c825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92b6c8a-d0df-4b9a-9864-7c2f7514c825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b725c51-1f1e-4c04-ab3f-04a44e76cda8', 'volume_name': 'volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b45e2cd-86bd-469b-8f6e-894cdfa5f2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b45e2cd-86bd-469b-8f6e-894cdfa5f2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2815b1a3-3531-48eb-9c07-05d2591e7329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:19 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Volume 8b725c51-1f1e-4c04-ab3f-04a44e76cda8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8', 'volume_size': 1} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-56600211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b725c51-1f1e-4c04-ab3f-04a44e76cda8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ade64f2b1245fc8d8321dad28061d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:20Z,use_quota=True,user_id='ef93b3e88b3644e2a143f87acc1cd6df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Creating volume 8b725c51-1f1e-4c04-ab3f-04a44e76cda8 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:57:19 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:57:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:19 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8 1073741824 Jul 24 15:57:19 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:20 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8 1073741824" returned: 0 in 0.664s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:20 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8 Jul 24 15:57:20 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:21 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8" returned: 0 in 0.362s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:57:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2815b1a3-3531-48eb-9c07-05d2591e7329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3853da0c-5375-4089-a606-4d6a1952ef04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:21 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Volume volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8 (8b725c51-1f1e-4c04-ab3f-04a44e76cda8): created successfully Jul 24 15:57:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3853da0c-5375-4089-a606-4d6a1952ef04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Flow 'volume_create_manager' (d98b3728-71ba-4f88-8821-177bf4d75f5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:21 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-4cb7cec2-fdf0-4192-a794-2ffd9204f824 tempest-ProjectReaderTests-19692877 None] Created volume successfully. Jul 24 15:57:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Acquiring lock "cinder-8b725c51-1f1e-4c04-ab3f-04a44e76cda8-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Lock "cinder-8b725c51-1f1e-4c04-ab3f-04a44e76cda8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Acquiring lock "cinder-quobyte-8b725c51-1f1e-4c04-ab3f-04a44e76cda8" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Lock "cinder-quobyte-8b725c51-1f1e-4c04-ab3f-04a44e76cda8" acquired by "delete_volume" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:22 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca8ef94-77b9-4e40-9bd1-1a088fb9bf24]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:22 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8 Jul 24 15:57:22 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:22 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8" returned: 0 in 0.438s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:22 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8 Jul 24 15:57:22 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:22 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8b725c51-1f1e-4c04-ab3f-04a44e76cda8" returned: 0 in 0.279s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Lock "cinder-quobyte-8b725c51-1f1e-4c04-ab3f-04a44e76cda8" released by "delete_volume" :: held 0.762s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:22 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Created reservations ['e8642d8b-9565-4625-ba5e-cbd2c45433a6', '053fc433-a597-4442-8845-8cf0f0c284e0', 'ceeed6fe-c8af-483e-b1be-09884be3a9d5', 'da7c7fbb-1f74-46fd-b72b-8d3ae1104124'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:23 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:57:23 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:23 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.275s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:23 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:23 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Deleted volume successfully. Jul 24 15:57:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1df93133-28db-4b35-a288-89af9d9e644b tempest-ProjectReaderTests-19692877 None] Lock "cinder-8b725c51-1f1e-4c04-ab3f-04a44e76cda8-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:23 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:57:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Flow 'volume_create_manager' (d17790a5-56ce-45e5-9f70-aff6dd690633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b86dbd7-68cd-406a-b667-1edbf078b216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b86dbd7-68cd-406a-b667-1edbf078b216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-76149745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf4d935-29da-44b8-9bf9-9526fff1725a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ade64f2b1245fc8d8321dad28061d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:24Z,use_quota=True,user_id='ef93b3e88b3644e2a143f87acc1cd6df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0586a2-bfc5-4769-8368-b5684296be59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0586a2-bfc5-4769-8368-b5684296be59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f56bb9e-14e1-4188-9357-5c1f07ebfcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f56bb9e-14e1-4188-9357-5c1f07ebfcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf4d935-29da-44b8-9bf9-9526fff1725a', 'volume_name': 'volume-ebf4d935-29da-44b8-9bf9-9526fff1725a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b94ec8e-6867-4e53-b52f-b18754295fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b94ec8e-6867-4e53-b52f-b18754295fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66de39c-0783-4615-a10d-baa2de5a6052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:24 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Volume ebf4d935-29da-44b8-9bf9-9526fff1725a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf4d935-29da-44b8-9bf9-9526fff1725a', 'volume_size': 1} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-76149745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf4d935-29da-44b8-9bf9-9526fff1725a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ade64f2b1245fc8d8321dad28061d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:24Z,use_quota=True,user_id='ef93b3e88b3644e2a143f87acc1cd6df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Creating volume ebf4d935-29da-44b8-9bf9-9526fff1725a {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:57:24 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ebf4d935-29da-44b8-9bf9-9526fff1725a 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:24 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ebf4d935-29da-44b8-9bf9-9526fff1725a 1073741824 Jul 24 15:57:24 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:24 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ebf4d935-29da-44b8-9bf9-9526fff1725a 1073741824" returned: 0 in 0.546s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ebf4d935-29da-44b8-9bf9-9526fff1725a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:24 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ebf4d935-29da-44b8-9bf9-9526fff1725a Jul 24 15:57:24 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:25 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ebf4d935-29da-44b8-9bf9-9526fff1725a" returned: 0 in 0.346s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:57:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66de39c-0783-4615-a10d-baa2de5a6052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf4d935-29da-44b8-9bf9-9526fff1725a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de02bb29-e380-47a2-bdc9-1355b81a91b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:25 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Volume volume-ebf4d935-29da-44b8-9bf9-9526fff1725a (ebf4d935-29da-44b8-9bf9-9526fff1725a): created successfully Jul 24 15:57:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de02bb29-e380-47a2-bdc9-1355b81a91b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Flow 'volume_create_manager' (d17790a5-56ce-45e5-9f70-aff6dd690633) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:25 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-8ee0f910-50f1-452a-822d-d3d2d8e1b2f6 tempest-ProjectReaderTests-19692877 None] Created volume successfully. Jul 24 15:57:25 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Acquiring lock "cinder-ebf4d935-29da-44b8-9bf9-9526fff1725a-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Lock "cinder-ebf4d935-29da-44b8-9bf9-9526fff1725a-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Acquiring lock "cinder-quobyte-ebf4d935-29da-44b8-9bf9-9526fff1725a" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:57:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Lock "cinder-quobyte-ebf4d935-29da-44b8-9bf9-9526fff1725a" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:57:26 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6307e134-591a-4ca8-b1dc-67f12ab3c6eb]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:57:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ebf4d935-29da-44b8-9bf9-9526fff1725a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:26 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ebf4d935-29da-44b8-9bf9-9526fff1725a Jul 24 15:57:26 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:26 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ebf4d935-29da-44b8-9bf9-9526fff1725a" returned: 0 in 0.513s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ebf4d935-29da-44b8-9bf9-9526fff1725a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:26 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ebf4d935-29da-44b8-9bf9-9526fff1725a Jul 24 15:57:26 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:27 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ebf4d935-29da-44b8-9bf9-9526fff1725a" returned: 0 in 0.352s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Lock "cinder-quobyte-ebf4d935-29da-44b8-9bf9-9526fff1725a" released by "delete_volume" :: held 0.919s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:27 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Created reservations ['79e22b43-51b4-46a9-a8a0-455c60923040', 'e624d80c-e8fe-4b25-b14e-782a61f63150', 'd4860b61-7f0d-4129-acb9-5cdbbec4fe22', 'd27a7d1d-7472-47de-9631-6e3ef1373430'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:57:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:27 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:57:27 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:27 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.266s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:27 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:27 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Deleted volume successfully. Jul 24 15:57:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9d280e05-d6c5-4e75-b939-cd391befc4de tempest-ProjectReaderTests-19692877 None] Lock "cinder-ebf4d935-29da-44b8-9bf9-9526fff1725a-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:57:37 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=27,cinder:SELECT=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:57:37 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=13,cinder:UPDATE=18,cinder:INSERT=6,cinder:DELETE=3 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:57:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:57:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:40 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:57:40 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:40 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.476s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:57:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:57:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:57:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Flow 'volume_create_manager' (c8baef52-25d3-44df-baba-39f91a89a78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f254fafb-92bb-443e-9d6a-b4167d427482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f254fafb-92bb-443e-9d6a-b4167d427482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1147987394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f26c9857-820e-4754-adc6-d9d3e2b22bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41114d7885749a69c6180e06c0795b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:41Z,use_quota=True,user_id='f5b3619af7774c1dbac9abfcd8ca82f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d0ea87-ca98-4840-871e-df41fa5a95a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d0ea87-ca98-4840-871e-df41fa5a95a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936118db-06f6-47d3-ab15-71e90ba89386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936118db-06f6-47d3-ab15-71e90ba89386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f26c9857-820e-4754-adc6-d9d3e2b22bf8', 'volume_name': 'volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82aed5a6-09f5-4bfb-9b73-1b315162d6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82aed5a6-09f5-4bfb-9b73-1b315162d6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e77a398-dfec-4478-bbb2-db5d47f3cbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:41 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Volume f26c9857-820e-4754-adc6-d9d3e2b22bf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8', 'volume_size': 1} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1147987394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f26c9857-820e-4754-adc6-d9d3e2b22bf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41114d7885749a69c6180e06c0795b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:41Z,use_quota=True,user_id='f5b3619af7774c1dbac9abfcd8ca82f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Creating volume f26c9857-820e-4754-adc6-d9d3e2b22bf8 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:57:41 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:57:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:41 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8 1073741824 Jul 24 15:57:41 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Flow 'volume_create_manager' (7859a95f-b339-4d9a-970e-af31fb51d970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40431830-95d9-426b-94d2-f9df84de8004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40431830-95d9-426b-94d2-f9df84de8004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2092789335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1515521e-ad1b-4ace-bf0f-de4af81ec64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41114d7885749a69c6180e06c0795b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:42Z,use_quota=True,user_id='f5b3619af7774c1dbac9abfcd8ca82f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c825654b-7969-46ee-bc56-56a2a60db465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c825654b-7969-46ee-bc56-56a2a60db465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa893141-f1e2-469d-9f20-e5138eab4400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa893141-f1e2-469d-9f20-e5138eab4400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1515521e-ad1b-4ace-bf0f-de4af81ec64b', 'volume_name': 'volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77a093f-78d5-458a-b2e6-4179d9bbbca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77a093f-78d5-458a-b2e6-4179d9bbbca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de44dd85-fddf-480d-abf1-07089025190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:42 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Volume 1515521e-ad1b-4ace-bf0f-de4af81ec64b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b', 'volume_size': 1} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:42 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8 1073741824" returned: 0 in 0.655s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:42 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8 Jul 24 15:57:42 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:42 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8" returned: 0 in 0.300s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2092789335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1515521e-ad1b-4ace-bf0f-de4af81ec64b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41114d7885749a69c6180e06c0795b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:57:42Z,use_quota=True,user_id='f5b3619af7774c1dbac9abfcd8ca82f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Creating volume 1515521e-ad1b-4ace-bf0f-de4af81ec64b {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:57:42 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:42 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b 1073741824 Jul 24 15:57:42 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e77a398-dfec-4478-bbb2-db5d47f3cbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bb4782-0cd0-41dd-86a0-dd006275c39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:42 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Volume volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8 (f26c9857-820e-4754-adc6-d9d3e2b22bf8): created successfully Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3bb4782-0cd0-41dd-86a0-dd006275c39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Flow 'volume_create_manager' (c8baef52-25d3-44df-baba-39f91a89a78c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:42 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-5db49df2-b4d3-4db3-9bcd-22ab8fcd2294 tempest-TestServerVolumeAttachmentScenario-246910700 None] Created volume successfully. Jul 24 15:57:43 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b 1073741824" returned: 0 in 0.600s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:57:43 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b Jul 24 15:57:43 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:57:43 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 24 15:57:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b" returned: 0 in 0.453s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:57:43 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:57:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:43 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de44dd85-fddf-480d-abf1-07089025190a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:43 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71300110-cb12-461e-874b-7848a30d0840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:57:43 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Volume volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b (1515521e-ad1b-4ace-bf0f-de4af81ec64b): created successfully Jul 24 15:57:43 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71300110-cb12-461e-874b-7848a30d0840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:57:43 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Flow 'volume_create_manager' (7859a95f-b339-4d9a-970e-af31fb51d970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:57:43 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1d6f8edd-d190-42bd-a0e5-6dabf9ed717e tempest-TestServerVolumeAttachmentScenario-246910700 None] Created volume successfully. Jul 24 15:57:47 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-04a28056-3fc6-47e7-92c9-634b4987ffdf req-d11b596d-6aaa-4066-b286-e166ca4c315f tempest-TestShelveInstance-1237774801 None] Terminate volume connection completed successfully. Jul 24 15:57:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-04a28056-3fc6-47e7-92c9-634b4987ffdf req-d11b596d-6aaa-4066-b286-e166ca4c315f tempest-TestShelveInstance-1237774801 None] Deleting attachment e3de9b29-9e44-46a3-bcb8-688324fdd35b. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:57:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-eb1b9695-80c2-4f47-bfc3-4e58893fc2e6 req-6bab4fef-778d-4d74-992e-ced3d1eb992d tempest-TestShelveInstance-1237774801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:57:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-eb1b9695-80c2-4f47-bfc3-4e58893fc2e6 req-6bab4fef-778d-4d74-992e-ced3d1eb992d tempest-TestShelveInstance-1237774801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:57:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-eb1b9695-80c2-4f47-bfc3-4e58893fc2e6 req-6bab4fef-778d-4d74-992e-ced3d1eb992d tempest-TestShelveInstance-1237774801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:57:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-eb1b9695-80c2-4f47-bfc3-4e58893fc2e6 req-6bab4fef-778d-4d74-992e-ced3d1eb992d tempest-TestShelveInstance-1237774801 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-6dda867f-b49f-4f1f-84c6-7240de6d5978', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fa20ef9-6077-4239-879a-baee93b63db5', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:57:55 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-eb1b9695-80c2-4f47-bfc3-4e58893fc2e6 req-6bab4fef-778d-4d74-992e-ced3d1eb992d tempest-TestShelveInstance-1237774801 None] attachment_update completed successfully. Jul 24 15:58:05 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=8,cinder:SELECT=12,cinder:INSERT=2,cinder:DELETE=2 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:58:05 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=11,cinder:UPDATE=7 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Flow 'volume_create_manager' (d24305c5-0b1a-4fe1-a39b-0da224df0a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f3a260-f7ba-414f-8fcf-207579175aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59f3a260-f7ba-414f-8fcf-207579175aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1471529110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc3da27-2839-4840-b4a3-f39c45c7a4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c00e7fa7744e2083bcd63efb43a017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:58:11Z,use_quota=True,user_id='af07ec4280184ce3b7a7bddbd2e24d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e124c9-7c55-417f-97d1-7c50c45d179c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e124c9-7c55-417f-97d1-7c50c45d179c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28bcb99-e180-48ce-ac85-c9a914091b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e28bcb99-e180-48ce-ac85-c9a914091b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddc3da27-2839-4840-b4a3-f39c45c7a4e2', 'volume_name': 'volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5dcf1d2-64cc-4e07-8f02-0c4cc98778f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5dcf1d2-64cc-4e07-8f02-0c4cc98778f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4adf4eb9-5807-4dfc-b9f2-f352476d00d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:10 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Volume ddc3da27-2839-4840-b4a3-f39c45c7a4e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2', 'volume_size': 1} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1471529110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc3da27-2839-4840-b4a3-f39c45c7a4e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c00e7fa7744e2083bcd63efb43a017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:58:11Z,use_quota=True,user_id='af07ec4280184ce3b7a7bddbd2e24d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Creating volume ddc3da27-2839-4840-b4a3-f39c45c7a4e2 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:58:10 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:58:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:10 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 1073741824 Jul 24 15:58:10 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:11 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 1073741824" returned: 0 in 0.580s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:11 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 Jul 24 15:58:11 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:11 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2" returned: 0 in 0.312s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:58:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4adf4eb9-5807-4dfc-b9f2-f352476d00d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e35a19-036f-47d0-bed8-087463c846bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:11 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Volume volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 (ddc3da27-2839-4840-b4a3-f39c45c7a4e2): created successfully Jul 24 15:58:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e35a19-036f-47d0-bed8-087463c846bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Flow 'volume_create_manager' (d24305c5-0b1a-4fe1-a39b-0da224df0a51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:58:11 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c3f1dc27-5132-4deb-9c4b-6bfcd1fcdc44 tempest-SnapshotDependencyTests-1896320173 None] Created volume successfully. Jul 24 15:58:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] Creating offline snapshot 1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 of volume ddc3da27-2839-4840-b4a3-f39c45c7a4e2 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 15:58:13 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1681db88-770e-4354-b000-0e122897c63b]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:13 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 Jul 24 15:58:13 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:13 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2" returned: 0 in 0.384s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:13 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 1G Jul 24 15:58:13 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:13 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 1G" returned: 0 in 0.399s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:13 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 Jul 24 15:58:13 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:14 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6" returned: 0 in 0.291s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:14 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 is being set with open permissions: ugo+rw Jul 24 15:58:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:14 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 Jul 24 15:58:14 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:14 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6" returned: 0 in 0.263s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:14 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.info Jul 24 15:58:14 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:14 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.info" returned: 0 in 0.279s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:14 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.info is being set with open permissions: ugo+rw Jul 24 15:58:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:14 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.info Jul 24 15:58:14 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:15 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.info" returned: 0 in 0.265s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:15 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-9f8c63d6-d3ae-4502-8ebb-fa870148cac9 tempest-SnapshotDependencyTests-1896320173 None] Create snapshot completed successfully Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Flow 'volume_create_manager' (8145ef03-b2f4-4449-b13f-2ad88edadfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39ec622-162e-4dbd-b11f-b7510138a713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39ec622-162e-4dbd-b11f-b7510138a713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5c00e7fa7744e2083bcd63efb43a017',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:58:16Z,use_quota=True,user_id='af07ec4280184ce3b7a7bddbd2e24d64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979a73f5-0e53-42cf-91d7-112db2934de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979a73f5-0e53-42cf-91d7-112db2934de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af294c5f-f612-4a72-8861-30dcf73635ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af294c5f-f612-4a72-8861-30dcf73635ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882', 'volume_name': 'volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882', 'volume_size': 1, 'snapshot_id': '1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c959591a-2243-44a7-8e08-189b5d381a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c959591a-2243-44a7-8e08-189b5d381a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea865172-98fe-4987-9fab-f4033423b713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:15 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Volume bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882', 'volume_size': 1, 'snapshot_id': '1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6'} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "cinder-quobyte-1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882" by "_create_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-quobyte-1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Creating volume bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882 from snapshot 1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 {{(pid=88350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:58:15 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "cinder-quobyte-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882" by "_copy_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-quobyte-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] snapshot: 1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6, volume: bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882, {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caba66f-bcc8-430d-a203-3728c2e97aaf]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:16 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 Jul 24 15:58:16 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:16 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6" returned: 0 in 0.407s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Creating direct copy from snapshot {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2772d25-5581-4e79-930f-cea0ab01bdb5]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:16 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 Jul 24 15:58:16 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:16 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2" returned: 0 in 0.394s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG cinder.utils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Path /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882 not found in is_blk_device check {{(pid=88350) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 15:58:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:16 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882 Jul 24 15:58:16 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:22 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882" returned: 0 in 6.071s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:22 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[51450240-b7e8-40c2-b1d6-862ad5b36713]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:23 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 Jul 24 15:58:23 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-09bace3e-1c74-401a-994a-749214ebfd16 req-3c23d6ba-6f63-4f74-855c-02c112b2f95e tempest-TestServerVolumeAttachmentScenario-246910700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:23 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2" returned: 0 in 0.604s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:23 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Image conversion details: src /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2, size 1024.00 MB, duration 6.07 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882 {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:58:23 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Converted 1024.00 MB image at 168.62 MB/s Jul 24 15:58:23 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882 is being set with open permissions: ugo+rw Jul 24 15:58:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:23 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882 Jul 24 15:58:23 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:23 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882" returned: 0 in 0.251s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-quobyte-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882" released by "_copy_volume_from_snapshot" :: held 7.826s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-quobyte-1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882" released by "_create_volume_from_snapshot" :: held 7.859s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.876s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-09bace3e-1c74-401a-994a-749214ebfd16 req-3c23d6ba-6f63-4f74-855c-02c112b2f95e tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.461s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-09bace3e-1c74-401a-994a-749214ebfd16 req-3c23d6ba-6f63-4f74-855c-02c112b2f95e tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea865172-98fe-4987-9fab-f4033423b713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882', 'volume_size': 1, 'snapshot_id': '1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c943b5-67c3-4652-855c-d69092029600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:23 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Volume volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882 (bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882): created successfully Jul 24 15:58:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c943b5-67c3-4652-855c-d69092029600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Flow 'volume_create_manager' (8145ef03-b2f4-4449-b13f-2ad88edadfa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:58:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-09bace3e-1c74-401a-994a-749214ebfd16 req-3c23d6ba-6f63-4f74-855c-02c112b2f95e tempest-TestServerVolumeAttachmentScenario-246910700 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '645c51f0-644b-4b10-b53d-c7a1119eee80', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:58:23 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-062d8ddb-a4d5-4d65-b437-b0bdbf8bcc84 tempest-SnapshotDependencyTests-1896320173 None] Created volume successfully. Jul 24 15:58:23 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-09bace3e-1c74-401a-994a-749214ebfd16 req-3c23d6ba-6f63-4f74-855c-02c112b2f95e tempest-TestServerVolumeAttachmentScenario-246910700 None] attachment_update completed successfully. Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "cinder-1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "cinder-quobyte-ddc3da27-2839-4840-b4a3-f39c45c7a4e2" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-quobyte-ddc3da27-2839-4840-b4a3-f39c45c7a4e2" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "cinder-quobyte-1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-quobyte-1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Deleting offline snapshot 1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 of volume ddc3da27-2839-4840-b4a3-f39c45c7a4e2 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] snapshot_file for this snap is: volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af50781-35bd-463a-a012-1f76110fc5b8]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:24 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 Jul 24 15:58:24 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:24 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6" returned: 0 in 0.394s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[766cd97c-bf85-4be8-aec0-358ec37618a5]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:24 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 Jul 24 15:58:24 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:24 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2" returned: 0 in 0.359s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:25 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 Jul 24 15:58:25 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:25 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6" returned: 0 in 0.362s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:25 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6 Jul 24 15:58:25 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:25 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2.1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6" returned: 0 in 0.238s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:25 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-quobyte-1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6" released by "_delete_snapshot" :: held 1.470s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:25 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-quobyte-ddc3da27-2839-4840-b4a3-f39c45c7a4e2" released by "delete_snapshot" :: held 1.496s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:25 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Created reservations ['74698b1d-a2fb-4241-89a0-826220e62451', 'b12d7c2f-d315-40ca-9964-2bfca19cdd61', '20e78496-c039-4699-b4a1-2ae8e7e5574e', '6516a5b5-6f54-4b87-b2a6-c135fdc74b8e'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:58:25 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Delete snapshot completed successfully. Jul 24 15:58:25 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ec7811d1-e3a6-4211-b766-f4895875a7b8 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-1344efd4-0c0e-4a41-b5b1-56a3c82a0fa6-delete_snapshot" released by "delete_snapshot" :: held 1.657s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "cinder-ddc3da27-2839-4840-b4a3-f39c45c7a4e2-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-ddc3da27-2839-4840-b4a3-f39c45c7a4e2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "cinder-quobyte-ddc3da27-2839-4840-b4a3-f39c45c7a4e2" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:26 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-quobyte-ddc3da27-2839-4840-b4a3-f39c45c7a4e2" acquired by "delete_volume" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:26 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a12430-8bc8-4a05-9b46-4326c383cd71]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:26 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 Jul 24 15:58:26 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:26 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2" returned: 0 in 0.368s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:26 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2 Jul 24 15:58:26 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:27 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ddc3da27-2839-4840-b4a3-f39c45c7a4e2" returned: 0 in 0.248s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-quobyte-ddc3da27-2839-4840-b4a3-f39c45c7a4e2" released by "delete_volume" :: held 0.687s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Created reservations ['3e9ded18-2bee-478d-82a3-8c9c4e73ba56', 'af65d668-e6e7-4b81-9e9f-fbd4509496ba', '090c2f5d-d76a-48cc-a149-f5a70cf9208e', '4cb0261d-9ea7-4c55-8fb8-1d329d41989e'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:27 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:58:27 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:27 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.262s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:58:27 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Deleted volume successfully. Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "cinder-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-c4cd766a-303a-4db9-82d1-8d3b41328fb4 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-ddc3da27-2839-4840-b4a3-f39c45c7a4e2-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "cinder-quobyte-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-quobyte-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba889b72-bb72-443a-a7fe-c38502449157]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:27 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882 Jul 24 15:58:27 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-9981510f-4e89-4925-9d04-91c8a7dd9133 req-9dd76b89-7669-476c-8a0c-898d9a1a9fa1 tempest-TestServerVolumeAttachmentScenario-246910700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-9981510f-4e89-4925-9d04-91c8a7dd9133 req-9dd76b89-7669-476c-8a0c-898d9a1a9fa1 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-9981510f-4e89-4925-9d04-91c8a7dd9133 req-9dd76b89-7669-476c-8a0c-898d9a1a9fa1 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-9981510f-4e89-4925-9d04-91c8a7dd9133 req-9dd76b89-7669-476c-8a0c-898d9a1a9fa1 tempest-TestServerVolumeAttachmentScenario-246910700 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd', 'name': 'volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9efd0b7-474d-47b6-96dd-4a9bca334ed7', 'enforce_multipath': True} {{(pid=88350) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 24 15:58:28 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882" returned: 0 in 0.428s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:28 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882 Jul 24 15:58:28 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:28 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-9981510f-4e89-4925-9d04-91c8a7dd9133 req-9dd76b89-7669-476c-8a0c-898d9a1a9fa1 tempest-TestServerVolumeAttachmentScenario-246910700 None] attachment_update completed successfully. Jul 24 15:58:28 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882" returned: 0 in 0.293s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-quobyte-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882" released by "delete_volume" :: held 0.793s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Created reservations ['dd096505-191d-4a3a-87e4-58c7adcec97b', '880a2466-f901-43c1-a6f5-e03cfa93f019', '2115674a-df2d-4e89-809a-03f1861a2b91', '425d97e0-c86a-4777-bbaf-cf017cf7f394'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:28 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:58:28 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:28 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.314s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:58:28 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Deleted volume successfully. Jul 24 15:58:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2d99557c-b2d3-4d24-949b-76ffb7e09e24 tempest-SnapshotDependencyTests-1896320173 None] Lock "cinder-bcb4c6cb-a8d1-40e7-8f67-03dd0fdce882-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:31 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-c00bcd17-8fc4-4c5f-b17a-b688355ebf0a req-8fef168d-45e2-4530-ae6d-b45562e847e2 tempest-TestServerVolumeAttachmentScenario-246910700 None] Terminate volume connection completed successfully. Jul 24 15:58:31 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-c00bcd17-8fc4-4c5f-b17a-b688355ebf0a req-8fef168d-45e2-4530-ae6d-b45562e847e2 tempest-TestServerVolumeAttachmentScenario-246910700 None] Deleting attachment b9efd0b7-474d-47b6-96dd-4a9bca334ed7. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:58:32 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-1d45cacb-2666-4cd2-a1df-08a9cf1e74e1 tempest-TestShelveInstance-1237774801 None] Terminate volume connection completed successfully. Jul 24 15:58:32 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-1d45cacb-2666-4cd2-a1df-08a9cf1e74e1 tempest-TestShelveInstance-1237774801 None] Deleting attachment 0fa20ef9-6077-4239-879a-baee93b63db5. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:58:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Acquiring lock "cinder-6dda867f-b49f-4f1f-84c6-7240de6d5978-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Lock "cinder-6dda867f-b49f-4f1f-84c6-7240de6d5978-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Acquiring lock "cinder-quobyte-6dda867f-b49f-4f1f-84c6-7240de6d5978" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Lock "cinder-quobyte-6dda867f-b49f-4f1f-84c6-7240de6d5978" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:33 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5e619c-c1c3-4c96-8c17-1660985acf9e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:33 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 Jul 24 15:58:33 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:33 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978" returned: 0 in 0.610s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:33 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978 Jul 24 15:58:33 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:33 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6dda867f-b49f-4f1f-84c6-7240de6d5978" returned: 0 in 0.307s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Lock "cinder-quobyte-6dda867f-b49f-4f1f-84c6-7240de6d5978" released by "delete_volume" :: held 0.992s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:34 devstack cinder-volume[88350]: DEBUG cinder.quota [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Created reservations ['a101e399-3260-438b-93b3-065a26af6d62', '964e54b3-9434-46ee-80c9-c12af3282ff9', '79e91194-5f96-4b53-bbbd-f0cd54ff458f', 'a87dcc20-e827-4845-9674-7c74fe6183e8'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:58:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:34 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:58:34 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:34 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-f6826f35-f197-4cd2-bed7-3e694b39d953 req-56d8ef02-43d4-4f24-b169-0b5cb89bd899 tempest-TestServerVolumeAttachmentScenario-246910700 None] Terminate volume connection completed successfully. Jul 24 15:58:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [req-f6826f35-f197-4cd2-bed7-3e694b39d953 req-56d8ef02-43d4-4f24-b169-0b5cb89bd899 tempest-TestServerVolumeAttachmentScenario-246910700 None] Deleting attachment 645c51f0-644b-4b10-b53d-c7a1119eee80. {{(pid=88350) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 24 15:58:34 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.469s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:34 devstack cinder-volume[88350]: DEBUG cinder.manager [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:58:34 devstack cinder-volume[88350]: INFO cinder.volume.manager [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Deleted volume successfully. Jul 24 15:58:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [req-53c09aa5-006e-42d7-81dc-1560acdd0a95 req-fa3a856e-66ac-445f-a6c7-be383b33a366 tempest-TestShelveInstance-1237774801 None] Lock "cinder-6dda867f-b49f-4f1f-84c6-7240de6d5978-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:58:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:40 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:58:40 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:40 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.265s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:58:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:58:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:58:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:58:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Acquiring lock "cinder-1515521e-ad1b-4ace-bf0f-de4af81ec64b-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "cinder-1515521e-ad1b-4ace-bf0f-de4af81ec64b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Acquiring lock "cinder-quobyte-1515521e-ad1b-4ace-bf0f-de4af81ec64b" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:42 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "cinder-quobyte-1515521e-ad1b-4ace-bf0f-de4af81ec64b" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:42 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9771fc01-0853-49ae-85dd-0993533108b3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:42 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b Jul 24 15:58:42 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:42 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b" returned: 0 in 0.413s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:42 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b Jul 24 15:58:42 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:43 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-1515521e-ad1b-4ace-bf0f-de4af81ec64b" returned: 0 in 0.282s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "cinder-quobyte-1515521e-ad1b-4ace-bf0f-de4af81ec64b" released by "delete_volume" :: held 0.743s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Created reservations ['a8e5fa21-001b-4f60-884e-0d0865f0c6b1', '75dae563-3fe3-4c20-9454-211eb45c54c5', '9145384c-70db-4da4-aae7-abac92f6b427', '8618e15c-445c-49fd-9e61-38f5f5adad50'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:43 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:58:43 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Acquiring lock "cinder-f26c9857-820e-4754-adc6-d9d3e2b22bf8-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "cinder-f26c9857-820e-4754-adc6-d9d3e2b22bf8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Acquiring lock "cinder-quobyte-f26c9857-820e-4754-adc6-d9d3e2b22bf8" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "cinder-quobyte-f26c9857-820e-4754-adc6-d9d3e2b22bf8" acquired by "delete_volume" :: waited 0.037s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:43 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.333s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:58:43 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Deleted volume successfully. Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf50cbd-f861-48d7-beef-2d24ba99c986]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-eb2f0b89-e849-4ff0-8337-73946efd5d74 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "cinder-1515521e-ad1b-4ace-bf0f-de4af81ec64b-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:43 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8 Jul 24 15:58:43 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:43 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8" returned: 0 in 0.381s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:44 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8 Jul 24 15:58:44 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:44 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f26c9857-820e-4754-adc6-d9d3e2b22bf8" returned: 0 in 0.284s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "cinder-quobyte-f26c9857-820e-4754-adc6-d9d3e2b22bf8" released by "delete_volume" :: held 0.715s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:44 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Created reservations ['fdb2ac9a-14b6-44b9-8d12-6f3cd3b870a0', 'd5bd1dff-7b30-4fde-b15e-f4717bde6698', 'def2a6d3-4cc5-4bcb-8955-e00c96e0d8ff', 'bc54fdf8-0197-4903-9021-83821a9d9964'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:58:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:44 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:58:44 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:44 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.253s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:44 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:58:44 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Deleted volume successfully. Jul 24 15:58:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-8227722c-dc06-49a3-b8f8-d2a3892109d6 tempest-TestServerVolumeAttachmentScenario-246910700 None] Lock "cinder-f26c9857-820e-4754-adc6-d9d3e2b22bf8-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Flow 'volume_create_manager' (f5544031-d67f-4e46-b2aa-c504a1477a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec0006f2-e47c-421d-8303-531e7f3040da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec0006f2-e47c-421d-8303-531e7f3040da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a843ea-bf5d-48b8-93f4-b95480230e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7acbc7086546fdb1d91f6922717230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:58:51Z,use_quota=True,user_id='4efb759d27304ff881ef5e6c4c16e816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e2a93-9ff6-4cf9-a68f-2200f013bc9b),volume_type_id=c82e2a93-9ff6-4cf9-a68f-2200f013bc9b)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d6ac10-fe76-4892-869e-a3df8463cb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09d6ac10-fe76-4892-869e-a3df8463cb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad33ca9c-16e7-4dbc-ac2b-0268908b61be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG cinder.image.glance [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Creating Keystone auth plugin from conf {{(pid=88350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad33ca9c-16e7-4dbc-ac2b-0268908b61be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd4a843ea-bf5d-48b8-93f4-b95480230e89', 'volume_name': 'volume-d4a843ea-bf5d-48b8-93f4-b95480230e89', 'volume_size': 1, 'image_id': 'e6f9597a-0894-4e07-9eb3-fc9fab2dbaca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e6f9597a-0894-4e07-9eb3-fc9fab2dbaca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd7bc4519b3764f667a2988257732286', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a7acbc7086546fdb1d91f6922717230', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f5b75283db616d02965350dc7632593fd3a849916bba4c7211e359b842ae8f2326154b0c76ab924cf59e44c7644837b731cf6a1892a24afb8758ba40bd58c3c4', 'id': 'e6f9597a-0894-4e07-9eb3-fc9fab2dbaca', 'created_at': datetime.datetime(2026, 7, 24, 13, 58, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 58, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e6f9597a-0894-4e07-9eb3-fc9fab2dbaca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d94b65a-2efb-4d15-acbc-c9ade24064ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d94b65a-2efb-4d15-acbc-c9ade24064ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c76ab0-e3c8-49e1-93d4-79955c32d56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:51 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Volume d4a843ea-bf5d-48b8-93f4-b95480230e89: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d4a843ea-bf5d-48b8-93f4-b95480230e89', 'volume_size': 1, 'image_id': 'e6f9597a-0894-4e07-9eb3-fc9fab2dbaca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e6f9597a-0894-4e07-9eb3-fc9fab2dbaca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd7bc4519b3764f667a2988257732286', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a7acbc7086546fdb1d91f6922717230', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f5b75283db616d02965350dc7632593fd3a849916bba4c7211e359b842ae8f2326154b0c76ab924cf59e44c7644837b731cf6a1892a24afb8758ba40bd58c3c4', 'id': 'e6f9597a-0894-4e07-9eb3-fc9fab2dbaca', 'created_at': datetime.datetime(2026, 7, 24, 13, 58, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 58, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e6f9597a-0894-4e07-9eb3-fc9fab2dbaca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Trying to clone d4a843ea-bf5d-48b8-93f4-b95480230e89 from image e6f9597a-0894-4e07-9eb3-fc9fab2dbaca at location (None, [{'url': 'file:///opt/stack/data/glance/images/e6f9597a-0894-4e07-9eb3-fc9fab2dbaca', 'metadata': {}}]). {{(pid=88350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 15:58:51 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Image download 0.00 MB at 0.00 MB/s Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef96b4f-c003-4351-ae63-51e7f6c52cfe]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:51 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD Jul 24 15:58:51 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:52 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:52 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD Jul 24 15:58:52 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:52 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:58:52 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Temporary image e6f9597a-0894-4e07-9eb3-fc9fab2dbaca is fetched for user 4efb759d27304ff881ef5e6c4c16e816. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 15:58:52 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[64835a91-cdb8-4079-b01a-5f0b15f2dde6]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:52 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD Jul 24 15:58:52 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:52 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:53 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD Jul 24 15:58:53 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:53 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:58:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a843ea-bf5d-48b8-93f4-b95480230e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7acbc7086546fdb1d91f6922717230',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:58:51Z,use_quota=True,user_id='4efb759d27304ff881ef5e6c4c16e816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c82e2a93-9ff6-4cf9-a68f-2200f013bc9b),volume_type_id=c82e2a93-9ff6-4cf9-a68f-2200f013bc9b)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:58:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Creating volume d4a843ea-bf5d-48b8-93f4-b95480230e89 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:58:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:58:53 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:58:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:53 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 1073741824 Jul 24 15:58:53 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:53 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 1073741824" returned: 0 in 0.459s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:53 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 Jul 24 15:58:53 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:54 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89" returned: 0 in 0.251s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:58:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:54 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Attempting download of e6f9597a-0894-4e07-9eb3-fc9fab2dbaca ((None, [{'url': 'file:///opt/stack/data/glance/images/e6f9597a-0894-4e07-9eb3-fc9fab2dbaca', 'metadata': {}}])) to volume d4a843ea-bf5d-48b8-93f4-b95480230e89. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 15:58:54 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faf5992-9ab3-4e9a-afe0-d03e27942adf]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_p4ejvyjg {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:54 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_p4ejvyjg Jul 24 15:58:54 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:54 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_p4ejvyjg" returned: 0 in 0.367s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_p4ejvyjg {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:54 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_p4ejvyjg Jul 24 15:58:54 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:54 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_p4ejvyjg" returned: 1 in 0.332s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_p4ejvyjg' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:58:54 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9115c619-cfd4-471e-b4ee-cc0ac8e734d9]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:55 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD Jul 24 15:58:55 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:55 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:55 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD Jul 24 15:58:55 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:55 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 15:58:55 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] e6f9597a-0894-4e07-9eb3-fc9fab2dbaca was raw, converting to qcow2 {{(pid=88350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 15:58:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:55 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 Jul 24 15:58:55 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:56 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89" returned: 0 in 0.499s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:56 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e6f9597a-0894-4e07-9eb3-fc9fab2dbaca_ngxbl23edevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:58:56 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 15:58:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:56 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 1G Jul 24 15:58:56 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:56 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 1G" returned: 0 in 0.316s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:56 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Downloaded image e6f9597a-0894-4e07-9eb3-fc9fab2dbaca ((None, [{'url': 'file:///opt/stack/data/glance/images/e6f9597a-0894-4e07-9eb3-fc9fab2dbaca', 'metadata': {}}])) to volume d4a843ea-bf5d-48b8-93f4-b95480230e89 successfully. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 15:58:56 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Temporary image e6f9597a-0894-4e07-9eb3-fc9fab2dbaca for user 4efb759d27304ff881ef5e6c4c16e816 is deleted. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 15:58:56 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Marking volume d4a843ea-bf5d-48b8-93f4-b95480230e89 as bootable. {{(pid=88350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 15:58:56 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Copying metadata from image e6f9597a-0894-4e07-9eb3-fc9fab2dbaca to d4a843ea-bf5d-48b8-93f4-b95480230e89. {{(pid=88350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 15:58:56 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Creating volume glance metadata for volume d4a843ea-bf5d-48b8-93f4-b95480230e89 backed by image e6f9597a-0894-4e07-9eb3-fc9fab2dbaca with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e6f9597a-0894-4e07-9eb3-fc9fab2dbaca', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cd7bc4519b3764f667a2988257732286', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 15:58:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74c76ab0-e3c8-49e1-93d4-79955c32d56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a843ea-bf5d-48b8-93f4-b95480230e89', 'volume_size': 1, 'image_id': 'e6f9597a-0894-4e07-9eb3-fc9fab2dbaca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e6f9597a-0894-4e07-9eb3-fc9fab2dbaca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cd7bc4519b3764f667a2988257732286', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0a7acbc7086546fdb1d91f6922717230', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f5b75283db616d02965350dc7632593fd3a849916bba4c7211e359b842ae8f2326154b0c76ab924cf59e44c7644837b731cf6a1892a24afb8758ba40bd58c3c4', 'id': 'e6f9597a-0894-4e07-9eb3-fc9fab2dbaca', 'created_at': datetime.datetime(2026, 7, 24, 13, 58, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 13, 58, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e6f9597a-0894-4e07-9eb3-fc9fab2dbaca/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d27541-2fab-47ec-b759-15296d393828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:58:56 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Volume volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 (d4a843ea-bf5d-48b8-93f4-b95480230e89): created successfully Jul 24 15:58:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6d27541-2fab-47ec-b759-15296d393828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:58:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Flow 'volume_create_manager' (f5544031-d67f-4e46-b2aa-c504a1477a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:58:56 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7477c40d-b4a0-46ea-bc38-6d286fe7f3fc tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Created volume successfully. Jul 24 15:58:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Acquiring lock "cinder-d4a843ea-bf5d-48b8-93f4-b95480230e89-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Lock "cinder-d4a843ea-bf5d-48b8-93f4-b95480230e89-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Acquiring lock "cinder-quobyte-d4a843ea-bf5d-48b8-93f4-b95480230e89" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:58:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Lock "cinder-quobyte-d4a843ea-bf5d-48b8-93f4-b95480230e89" acquired by "delete_volume" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:58:57 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f929d07d-3bb7-44da-aed7-c484f47e8eef]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:58:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:57 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 Jul 24 15:58:57 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:58 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89" returned: 0 in 0.379s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:58 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89 Jul 24 15:58:58 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:58 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d4a843ea-bf5d-48b8-93f4-b95480230e89" returned: 0 in 0.257s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Lock "cinder-quobyte-d4a843ea-bf5d-48b8-93f4-b95480230e89" released by "delete_volume" :: held 0.673s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:58:58 devstack cinder-volume[88350]: WARNING cinder.quota [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:58:58 devstack cinder-volume[88350]: WARNING cinder.quota [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 24 15:58:58 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Created reservations ['df96105b-9db5-491f-b41a-48a716273ad4', '2defb8b6-6190-4862-98f4-030aca8a7dc3', '5067488f-38f6-4677-99a5-b831161e81a4', '087c3b8a-8c22-406a-8c2c-b0a3d95cea67'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:58:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:58:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:58:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:58:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:58:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:58:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:58:58 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:58:58 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:58:58 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jul 24 15:58:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.257s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:58:58 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:58:58 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Deleted volume successfully. Jul 24 15:58:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bf37e8b4-fc3b-44ae-9958-23a4d1da8a2a tempest-VolumeAndVolumeTypeFromImageTest-39058771 None] Lock "cinder-d4a843ea-bf5d-48b8-93f4-b95480230e89-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:08 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=66,cinder:UPDATE=75,cinder:INSERT=22,cinder:DELETE=7 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:59:08 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=60,cinder:SELECT=69,cinder:INSERT=19,cinder:DELETE=3 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Flow 'volume_create_manager' (f61f1e9d-3cf7-4b81-a5b2-64e9ba83aff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930d1bcc-b1dd-4a19-81fc-b31b980cca8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (930d1bcc-b1dd-4a19-81fc-b31b980cca8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1648082280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00973f1a-787a-4536-926c-c189ef213545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9d88f864a74c2d98770f5a400da15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:10Z,use_quota=True,user_id='5b78e1e93ee543b7abb0a2ff6a912936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75feb51-28b7-40ac-ae69-4033bafa18ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75feb51-28b7-40ac-ae69-4033bafa18ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a21cfb-1ff6-464d-b8a2-106dcf195f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06a21cfb-1ff6-464d-b8a2-106dcf195f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00973f1a-787a-4536-926c-c189ef213545', 'volume_name': 'volume-00973f1a-787a-4536-926c-c189ef213545', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a7eecb-e579-499d-afe2-eaf22d0314b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72a7eecb-e579-499d-afe2-eaf22d0314b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03175647-28ba-4eed-96be-213a7f7084c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:09 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Volume 00973f1a-787a-4536-926c-c189ef213545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00973f1a-787a-4536-926c-c189ef213545', 'volume_size': 1} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1648082280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00973f1a-787a-4536-926c-c189ef213545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9d88f864a74c2d98770f5a400da15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:10Z,use_quota=True,user_id='5b78e1e93ee543b7abb0a2ff6a912936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Creating volume 00973f1a-787a-4536-926c-c189ef213545 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:09 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:59:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-00973f1a-787a-4536-926c-c189ef213545 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:09 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-00973f1a-787a-4536-926c-c189ef213545 1073741824 Jul 24 15:59:09 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:10 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-00973f1a-787a-4536-926c-c189ef213545 1073741824" returned: 0 in 0.431s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-00973f1a-787a-4536-926c-c189ef213545 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:10 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-00973f1a-787a-4536-926c-c189ef213545 Jul 24 15:59:10 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:10 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-00973f1a-787a-4536-926c-c189ef213545" returned: 0 in 0.288s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03175647-28ba-4eed-96be-213a7f7084c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00973f1a-787a-4536-926c-c189ef213545', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbc7137-212f-4172-96f7-f13adb28678d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:10 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Volume volume-00973f1a-787a-4536-926c-c189ef213545 (00973f1a-787a-4536-926c-c189ef213545): created successfully Jul 24 15:59:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdbc7137-212f-4172-96f7-f13adb28678d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Flow 'volume_create_manager' (f61f1e9d-3cf7-4b81-a5b2-64e9ba83aff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:10 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-943a6e3a-b1ff-4f5f-bb30-d2245bc90363 tempest-ProjectReaderTests-78815711 None] Created volume successfully. Jul 24 15:59:10 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Acquiring lock "cinder-00973f1a-787a-4536-926c-c189ef213545-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Lock "cinder-00973f1a-787a-4536-926c-c189ef213545-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Acquiring lock "cinder-quobyte-00973f1a-787a-4536-926c-c189ef213545" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Lock "cinder-quobyte-00973f1a-787a-4536-926c-c189ef213545" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:11 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[82678d5f-ed1d-4ff0-afbb-383c9dea725a]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-00973f1a-787a-4536-926c-c189ef213545 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:11 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-00973f1a-787a-4536-926c-c189ef213545 Jul 24 15:59:11 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:11 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-00973f1a-787a-4536-926c-c189ef213545" returned: 0 in 0.396s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-00973f1a-787a-4536-926c-c189ef213545 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:11 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-00973f1a-787a-4536-926c-c189ef213545 Jul 24 15:59:11 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:11 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-00973f1a-787a-4536-926c-c189ef213545" returned: 0 in 0.365s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Lock "cinder-quobyte-00973f1a-787a-4536-926c-c189ef213545" released by "delete_volume" :: held 0.814s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:11 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Created reservations ['c3397ff8-61f9-4183-b9f7-4bc2f58568e5', '76bc9b50-81aa-4a28-ac6b-322a5f0ead4e', 'e3c58091-fee5-42af-a679-98207fd175c8', '816d7d3c-0632-417d-98d6-b127b3d04578'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:12 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:59:12 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:12 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.274s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:12 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Deleted volume successfully. Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-cfa8c1bc-ab72-40ea-bcb8-aa6492582984 tempest-ProjectReaderTests-78815711 None] Lock "cinder-00973f1a-787a-4536-926c-c189ef213545-delete_volume" released by "delete_volume" :: held 1.344s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Flow 'volume_create_manager' (4f0c53ad-5afe-426d-b982-838d7112f18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac67659-78ed-4ba9-9eff-75af6e9a25ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac67659-78ed-4ba9-9eff-75af6e9a25ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-538863620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce8fbc6e-268d-4b8a-9dae-92dbf8196c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9d88f864a74c2d98770f5a400da15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:13Z,use_quota=True,user_id='5b78e1e93ee543b7abb0a2ff6a912936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719dfc59-83a5-4b28-b225-e7a2bfe156d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (719dfc59-83a5-4b28-b225-e7a2bfe156d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13fcc1df-8b79-4bde-8fc3-02303616bb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13fcc1df-8b79-4bde-8fc3-02303616bb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce8fbc6e-268d-4b8a-9dae-92dbf8196c65', 'volume_name': 'volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee3fef7-37c3-43de-9dce-173828aa6c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee3fef7-37c3-43de-9dce-173828aa6c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab79712-a75b-42a3-8990-d98a4c2f9c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:12 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Volume ce8fbc6e-268d-4b8a-9dae-92dbf8196c65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65', 'volume_size': 1} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-538863620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce8fbc6e-268d-4b8a-9dae-92dbf8196c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9d88f864a74c2d98770f5a400da15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:13Z,use_quota=True,user_id='5b78e1e93ee543b7abb0a2ff6a912936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Creating volume ce8fbc6e-268d-4b8a-9dae-92dbf8196c65 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:12 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:59:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:12 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65 1073741824 Jul 24 15:59:12 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:13 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65 1073741824" returned: 0 in 0.487s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:13 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65 Jul 24 15:59:13 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:13 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65" returned: 0 in 0.275s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cab79712-a75b-42a3-8990-d98a4c2f9c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed30981d-db15-4182-9302-cc83d45f7e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:13 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Volume volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65 (ce8fbc6e-268d-4b8a-9dae-92dbf8196c65): created successfully Jul 24 15:59:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed30981d-db15-4182-9302-cc83d45f7e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Flow 'volume_create_manager' (4f0c53ad-5afe-426d-b982-838d7112f18e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:13 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a26dd906-234d-4a55-bbab-4d22fad3e48b tempest-ProjectReaderTests-78815711 None] Created volume successfully. Jul 24 15:59:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Acquiring lock "cinder-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Lock "cinder-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Acquiring lock "cinder-quobyte-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Lock "cinder-quobyte-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65" acquired by "delete_volume" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:14 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[53450633-4ac8-4100-90a8-82e692d91a65]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:15 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65 Jul 24 15:59:15 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:15 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65" returned: 0 in 0.380s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:15 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65 Jul 24 15:59:15 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:15 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65" returned: 0 in 0.246s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:15 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Lock "cinder-quobyte-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65" released by "delete_volume" :: held 0.670s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:15 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Created reservations ['1f79cbad-0542-4700-a974-d4ed7859020e', '46133e2f-297e-4328-81c9-30fb59af13cb', 'b7927755-738c-4858-88f8-090166746e6c', 'd36006cd-d1be-4631-ba52-380cfff0a108'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:15 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:59:15 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:16 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.280s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:16 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Deleted volume successfully. Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ecf3126e-7dd7-4053-9d37-aa741c5c73e1 tempest-ProjectReaderTests-78815711 None] Lock "cinder-ce8fbc6e-268d-4b8a-9dae-92dbf8196c65-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Flow 'volume_create_manager' (a0a465a4-a619-4a6a-ac0d-c01fe2b235d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680cf912-84a1-44d6-872c-b63788401b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (680cf912-84a1-44d6-872c-b63788401b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220564480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531806a1-f5df-42b4-9e4f-b4611125834e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9d88f864a74c2d98770f5a400da15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:16Z,use_quota=True,user_id='5b78e1e93ee543b7abb0a2ff6a912936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c7d342-63ed-4471-8f19-fa8301bce607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c7d342-63ed-4471-8f19-fa8301bce607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47e4082-ffc0-4bff-bf4d-44c025688576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47e4082-ffc0-4bff-bf4d-44c025688576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '531806a1-f5df-42b4-9e4f-b4611125834e', 'volume_name': 'volume-531806a1-f5df-42b4-9e4f-b4611125834e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1f38b7-819d-4bb4-a92c-a861f446905c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1f38b7-819d-4bb4-a92c-a861f446905c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c5f0e2-0f66-42f2-bdeb-379ad1fdd351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:16 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Volume 531806a1-f5df-42b4-9e4f-b4611125834e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-531806a1-f5df-42b4-9e4f-b4611125834e', 'volume_size': 1} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220564480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531806a1-f5df-42b4-9e4f-b4611125834e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9d88f864a74c2d98770f5a400da15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:16Z,use_quota=True,user_id='5b78e1e93ee543b7abb0a2ff6a912936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Creating volume 531806a1-f5df-42b4-9e4f-b4611125834e {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:16 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:59:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-531806a1-f5df-42b4-9e4f-b4611125834e 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:16 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-531806a1-f5df-42b4-9e4f-b4611125834e 1073741824 Jul 24 15:59:16 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:17 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-531806a1-f5df-42b4-9e4f-b4611125834e 1073741824" returned: 0 in 0.457s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-531806a1-f5df-42b4-9e4f-b4611125834e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:17 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-531806a1-f5df-42b4-9e4f-b4611125834e Jul 24 15:59:17 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:17 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-531806a1-f5df-42b4-9e4f-b4611125834e" returned: 0 in 0.255s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28c5f0e2-0f66-42f2-bdeb-379ad1fdd351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531806a1-f5df-42b4-9e4f-b4611125834e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5039813-72be-4112-bd22-34b9f07f566d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:17 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Volume volume-531806a1-f5df-42b4-9e4f-b4611125834e (531806a1-f5df-42b4-9e4f-b4611125834e): created successfully Jul 24 15:59:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5039813-72be-4112-bd22-34b9f07f566d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Flow 'volume_create_manager' (a0a465a4-a619-4a6a-ac0d-c01fe2b235d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:17 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-bf4ada16-9b79-4d0d-b1f9-df2b7c0cd57a tempest-ProjectReaderTests-78815711 None] Created volume successfully. Jul 24 15:59:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Acquiring lock "cinder-531806a1-f5df-42b4-9e4f-b4611125834e-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Lock "cinder-531806a1-f5df-42b4-9e4f-b4611125834e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Acquiring lock "cinder-quobyte-531806a1-f5df-42b4-9e4f-b4611125834e" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Lock "cinder-quobyte-531806a1-f5df-42b4-9e4f-b4611125834e" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:17 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[640f2b1a-d2f8-4226-8f11-8a0febbe4e53]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-531806a1-f5df-42b4-9e4f-b4611125834e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:17 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-531806a1-f5df-42b4-9e4f-b4611125834e Jul 24 15:59:17 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:18 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-531806a1-f5df-42b4-9e4f-b4611125834e" returned: 0 in 0.410s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-531806a1-f5df-42b4-9e4f-b4611125834e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:18 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-531806a1-f5df-42b4-9e4f-b4611125834e Jul 24 15:59:18 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:18 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-531806a1-f5df-42b4-9e4f-b4611125834e" returned: 0 in 0.288s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Lock "cinder-quobyte-531806a1-f5df-42b4-9e4f-b4611125834e" released by "delete_volume" :: held 0.754s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Created reservations ['09d1b42b-5ab7-4995-80b8-6920588f03e0', '9d2918a8-0249-44d2-ba58-a347f102959f', '742a9579-44f0-4043-bdeb-2b5fe3f64bd5', '3c24391a-6264-43e7-a712-c8637592d64e'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:18 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:59:18 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Flow 'volume_create_manager' (1efe0bb3-7755-4b99-9c18-b10476884a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b1c15a-229c-4266-8b6f-62c34047f78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:18 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b1c15a-229c-4266-8b6f-62c34047f78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1295762522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323a3401-82dc-47cf-bead-6b714aab0a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f74f40567ef4403b6a35414a9ef9471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:19Z,use_quota=True,user_id='dcb279c559314b84936c97ae42fab05f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf36805-723d-4010-8bb3-106b640a57a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf36805-723d-4010-8bb3-106b640a57a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3200c67-9dde-40c1-80e7-9d0a5e03eafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3200c67-9dde-40c1-80e7-9d0a5e03eafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '323a3401-82dc-47cf-bead-6b714aab0a18', 'volume_name': 'volume-323a3401-82dc-47cf-bead-6b714aab0a18', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0b4c55-d731-41b5-aa2f-ec15a3703789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0b4c55-d731-41b5-aa2f-ec15a3703789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45824c8e-d3a7-4106-bcb7-483d771a3f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:18 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Volume 323a3401-82dc-47cf-bead-6b714aab0a18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-323a3401-82dc-47cf-bead-6b714aab0a18', 'volume_size': 1} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1295762522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323a3401-82dc-47cf-bead-6b714aab0a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f74f40567ef4403b6a35414a9ef9471',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:19Z,use_quota=True,user_id='dcb279c559314b84936c97ae42fab05f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Creating volume 323a3401-82dc-47cf-bead-6b714aab0a18 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:18 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.335s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:18 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Deleted volume successfully. Jul 24 15:59:18 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 1073741824 Jul 24 15:59:18 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d679ec3a-3545-45cf-8e67-73efe19a86a2 tempest-ProjectReaderTests-78815711 None] Lock "cinder-531806a1-f5df-42b4-9e4f-b4611125834e-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Flow 'volume_create_manager' (29d65d3d-4fcf-4998-85fe-fb14f6caf047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08139133-5b2b-4964-a8a4-96b394e3be57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08139133-5b2b-4964-a8a4-96b394e3be57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-501767165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc05cbc2-316c-4f03-9339-b0606dfba21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9d88f864a74c2d98770f5a400da15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:19Z,use_quota=True,user_id='5b78e1e93ee543b7abb0a2ff6a912936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d789ca-2841-4d70-9918-fe6d30de6614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6d789ca-2841-4d70-9918-fe6d30de6614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639e28e5-d384-4662-836c-6a8aac5ef91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639e28e5-d384-4662-836c-6a8aac5ef91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc05cbc2-316c-4f03-9339-b0606dfba21e', 'volume_name': 'volume-fc05cbc2-316c-4f03-9339-b0606dfba21e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd91be2-5f2e-4a5f-ab9b-7659968c4228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd91be2-5f2e-4a5f-ab9b-7659968c4228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14766607-467b-4e25-8681-22e51e95ff6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:19 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Volume fc05cbc2-316c-4f03-9339-b0606dfba21e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc05cbc2-316c-4f03-9339-b0606dfba21e', 'volume_size': 1} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:19 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 1073741824" returned: 0 in 0.467s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:19 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 Jul 24 15:59:19 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:19 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18" returned: 0 in 0.299s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.366s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-501767165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc05cbc2-316c-4f03-9339-b0606dfba21e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e9d88f864a74c2d98770f5a400da15f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:19Z,use_quota=True,user_id='5b78e1e93ee543b7abb0a2ff6a912936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Creating volume fc05cbc2-316c-4f03-9339-b0606dfba21e {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:19 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fc05cbc2-316c-4f03-9339-b0606dfba21e 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45824c8e-d3a7-4106-bcb7-483d771a3f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-323a3401-82dc-47cf-bead-6b714aab0a18', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:19 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fc05cbc2-316c-4f03-9339-b0606dfba21e 1073741824 Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98391138-b394-4b67-8127-7a6213826372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:19 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:19 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Volume volume-323a3401-82dc-47cf-bead-6b714aab0a18 (323a3401-82dc-47cf-bead-6b714aab0a18): created successfully Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98391138-b394-4b67-8127-7a6213826372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Flow 'volume_create_manager' (1efe0bb3-7755-4b99-9c18-b10476884a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:19 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-4c74cc5e-febb-42a3-b754-f9542c69bce4 tempest-TestImageHashVerification-925023646 None] Created volume successfully. Jul 24 15:59:20 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fc05cbc2-316c-4f03-9339-b0606dfba21e 1073741824" returned: 0 in 0.433s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fc05cbc2-316c-4f03-9339-b0606dfba21e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:20 devstack sudo[107236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fc05cbc2-316c-4f03-9339-b0606dfba21e Jul 24 15:59:20 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:20 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fc05cbc2-316c-4f03-9339-b0606dfba21e" returned: 0 in 0.244s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14766607-467b-4e25-8681-22e51e95ff6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc05cbc2-316c-4f03-9339-b0606dfba21e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77eabf08-6a84-4507-97e9-08460e1a35c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:20 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Volume volume-fc05cbc2-316c-4f03-9339-b0606dfba21e (fc05cbc2-316c-4f03-9339-b0606dfba21e): created successfully Jul 24 15:59:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77eabf08-6a84-4507-97e9-08460e1a35c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Flow 'volume_create_manager' (29d65d3d-4fcf-4998-85fe-fb14f6caf047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:20 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-6c83d42c-bdd8-4ec8-8c6f-c559472973f9 tempest-ProjectReaderTests-78815711 None] Created volume successfully. Jul 24 15:59:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Acquiring lock "cinder-fc05cbc2-316c-4f03-9339-b0606dfba21e-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Lock "cinder-fc05cbc2-316c-4f03-9339-b0606dfba21e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Acquiring lock "cinder-quobyte-fc05cbc2-316c-4f03-9339-b0606dfba21e" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Lock "cinder-quobyte-fc05cbc2-316c-4f03-9339-b0606dfba21e" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:21 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[671b7401-aad5-4321-b33f-50da86b40e44]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fc05cbc2-316c-4f03-9339-b0606dfba21e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:21 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fc05cbc2-316c-4f03-9339-b0606dfba21e Jul 24 15:59:21 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:21 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[23caaa04-2e16-43a9-9ce0-39c39c47cfd1]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:21 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 Jul 24 15:59:21 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:21 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fc05cbc2-316c-4f03-9339-b0606dfba21e" returned: 0 in 0.403s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fc05cbc2-316c-4f03-9339-b0606dfba21e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:21 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fc05cbc2-316c-4f03-9339-b0606dfba21e Jul 24 15:59:21 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:22 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18" returned: 0 in 0.384s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[190e8932-d5eb-4acf-a3d4-f0b74817a7bd]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:22 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-fc05cbc2-316c-4f03-9339-b0606dfba21e" returned: 0 in 0.265s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Lock "cinder-quobyte-fc05cbc2-316c-4f03-9339-b0606dfba21e" released by "delete_volume" :: held 0.714s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Created reservations ['d92421ef-9daf-407f-9afd-7b84167e29aa', 'd0b9310e-edd5-40fb-955d-28e7191e41ee', 'bbeaf310-e1e2-4621-a60b-321485911444', 'c143a989-ff3a-437e-99ce-b2660ee32b7c'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:22 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 Jul 24 15:59:22 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:22 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:59:22 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:22 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18" returned: 0 in 0.394s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 /opt/stack/data/cinder/conversion/323a3401-82dc-47cf-bead-6b714aab0a18.temp_image.6dafcdd3-72f0-4c7c-aca2-d74bc37a959a9xy2hyl6.img {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:22 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 /opt/stack/data/cinder/conversion/323a3401-82dc-47cf-bead-6b714aab0a18.temp_image.6dafcdd3-72f0-4c7c-aca2-d74bc37a959a9xy2hyl6.img Jul 24 15:59:22 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:22 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.266s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:22 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Deleted volume successfully. Jul 24 15:59:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-01cd49c3-f6cd-4955-aba7-104f3a137408 tempest-ProjectReaderTests-78815711 None] Lock "cinder-fc05cbc2-316c-4f03-9339-b0606dfba21e-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:27 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 /opt/stack/data/cinder/conversion/323a3401-82dc-47cf-bead-6b714aab0a18.temp_image.6dafcdd3-72f0-4c7c-aca2-d74bc37a959a9xy2hyl6.img" returned: 0 in 4.600s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:27 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4eacf9-0023-4ee9-badd-dd0e6bacae41]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:27 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 Jul 24 15:59:27 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:27 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18" returned: 0 in 0.528s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:27 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] Image conversion details: src /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18, size 1024.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/conversion/323a3401-82dc-47cf-bead-6b714aab0a18.temp_image.6dafcdd3-72f0-4c7c-aca2-d74bc37a959a9xy2hyl6.img {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 15:59:27 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] Converted 1024.00 MB image at 222.58 MB/s Jul 24 15:59:27 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] 6dafcdd3-72f0-4c7c-aca2-d74bc37a959a was raw, no need to convert to raw {{(pid=88350) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 24 15:59:36 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=29,cinder:UPDATE=45,cinder:DELETE=6,cinder:INSERT=12 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:59:37 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=50,cinder:SELECT=35,cinder:INSERT=9,cinder:DELETE=3 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 15:59:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 15:59:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 15:59:39 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 15:59:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.647s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] Uploaded volume to glance image-id: 6dafcdd3-72f0-4c7c-aca2-d74bc37a959a. {{(pid=88350) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 24 15:59:46 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a956e5f2-0868-41ec-be31-5700677e8c38 tempest-TestImageHashVerification-925023646 None] Copy volume to image completed successfully. Jul 24 15:59:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Acquiring lock "cinder-323a3401-82dc-47cf-bead-6b714aab0a18-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Lock "cinder-323a3401-82dc-47cf-bead-6b714aab0a18-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Acquiring lock "cinder-quobyte-323a3401-82dc-47cf-bead-6b714aab0a18" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 15:59:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Lock "cinder-quobyte-323a3401-82dc-47cf-bead-6b714aab0a18" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 15:59:47 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfa59b6-284f-4a1c-abbb-707a0fd784d9]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 15:59:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:47 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 Jul 24 15:59:47 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:47 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18" returned: 0 in 0.369s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:47 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18 Jul 24 15:59:47 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:48 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-323a3401-82dc-47cf-bead-6b714aab0a18" returned: 0 in 0.237s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:48 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Lock "cinder-quobyte-323a3401-82dc-47cf-bead-6b714aab0a18" released by "delete_volume" :: held 0.646s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:48 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Created reservations ['a706db22-c91b-4a7c-a467-a1a914e891b8', 'ee511924-47ee-4080-9ef5-57c4e3bb425d', '1cb23c03-5b11-4b1c-8ca7-f78d106675fb', '46545db4-8eee-492d-b8d7-861b3d0fcab4'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 15:59:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:48 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 15:59:48 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:48 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.248s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:48 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 15:59:48 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Deleted volume successfully. Jul 24 15:59:48 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cc9609a-75e1-4508-bad4-247925f70153 tempest-TestImageHashVerification-925023646 None] Lock "cinder-323a3401-82dc-47cf-bead-6b714aab0a18-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Flow 'volume_create_manager' (5bb3fe36-d442-4e10-9c4b-56c9b3483f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4221206b-7d1c-437f-89f9-31db86bd6a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4221206b-7d1c-437f-89f9-31db86bd6a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-713086130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d82ea2-8e38-4b05-b1ca-098390820da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa272c8dfb43b1bbf6c091e571106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:58Z,use_quota=True,user_id='973103f8438c4b9ca571ac96e748cc03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d45bcec-8fb2-4af5-930a-58e7a7f4191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d45bcec-8fb2-4af5-930a-58e7a7f4191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2237943-6e02-4253-8f66-65bf019c67b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2237943-6e02-4253-8f66-65bf019c67b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d82ea2-8e38-4b05-b1ca-098390820da8', 'volume_name': 'volume-05d82ea2-8e38-4b05-b1ca-098390820da8', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f74c27-8687-490f-9471-ee77c044103d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f74c27-8687-490f-9471-ee77c044103d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95214e32-d1b1-4987-b779-eda0c8a05f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:57 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Volume 05d82ea2-8e38-4b05-b1ca-098390820da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d82ea2-8e38-4b05-b1ca-098390820da8', 'volume_size': 1} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-713086130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d82ea2-8e38-4b05-b1ca-098390820da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa272c8dfb43b1bbf6c091e571106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:58Z,use_quota=True,user_id='973103f8438c4b9ca571ac96e748cc03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Creating volume 05d82ea2-8e38-4b05-b1ca-098390820da8 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:57 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:59:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-05d82ea2-8e38-4b05-b1ca-098390820da8 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:57 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-05d82ea2-8e38-4b05-b1ca-098390820da8 1073741824 Jul 24 15:59:58 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Flow 'volume_create_manager' (fdd17ca1-ed3b-4ea5-ae20-7ef5e481316c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdc66c4-4358-4822-b03f-f4ca7024126b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdc66c4-4358-4822-b03f-f4ca7024126b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-762462724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=025345e2-b4a3-41f7-aacd-6d6cfd0511a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa272c8dfb43b1bbf6c091e571106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:58Z,use_quota=True,user_id='973103f8438c4b9ca571ac96e748cc03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05f135b-1cc6-4ed2-a624-6992decef3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d05f135b-1cc6-4ed2-a624-6992decef3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6fbcc0-dfe9-4d1d-a393-2988825bfa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6fbcc0-dfe9-4d1d-a393-2988825bfa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '025345e2-b4a3-41f7-aacd-6d6cfd0511a4', 'volume_name': 'volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8e376c-58b8-4b9c-a6ae-ae0cafb96ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8e376c-58b8-4b9c-a6ae-ae0cafb96ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0723a4de-9528-4f38-81c5-9b7f939a517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:58 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Volume 025345e2-b4a3-41f7-aacd-6d6cfd0511a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4', 'volume_size': 1} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:58 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-05d82ea2-8e38-4b05-b1ca-098390820da8 1073741824" returned: 0 in 0.497s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-05d82ea2-8e38-4b05-b1ca-098390820da8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:58 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-05d82ea2-8e38-4b05-b1ca-098390820da8 Jul 24 15:59:58 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Flow 'volume_create_manager' (2535a501-91bd-4edd-be87-2e83fedc7615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026691f9-f647-49d6-861c-2249b18e8dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (026691f9-f647-49d6-861c-2249b18e8dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1498651615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b3f2c3-5034-4949-93e2-82c6f9b680f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa272c8dfb43b1bbf6c091e571106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:59Z,use_quota=True,user_id='973103f8438c4b9ca571ac96e748cc03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e7d7232-87bb-44fc-a609-947f94876dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e7d7232-87bb-44fc-a609-947f94876dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972bf9e1-0b52-4dee-b92d-222deed25dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972bf9e1-0b52-4dee-b92d-222deed25dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b3f2c3-5034-4949-93e2-82c6f9b680f0', 'volume_name': 'volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9aa31f-f07e-49a9-b4f1-252512d9ef2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9aa31f-f07e-49a9-b4f1-252512d9ef2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3429df9c-b77f-40f5-967b-69dc1fa8f24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:58 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Volume 72b3f2c3-5034-4949-93e2-82c6f9b680f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0', 'volume_size': 1} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:58 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-05d82ea2-8e38-4b05-b1ca-098390820da8" returned: 0 in 0.267s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.403s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-762462724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=025345e2-b4a3-41f7-aacd-6d6cfd0511a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa272c8dfb43b1bbf6c091e571106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:58Z,use_quota=True,user_id='973103f8438c4b9ca571ac96e748cc03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Creating volume 025345e2-b4a3-41f7-aacd-6d6cfd0511a4 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:58 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95214e32-d1b1-4987-b779-eda0c8a05f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d82ea2-8e38-4b05-b1ca-098390820da8', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:58 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4 1073741824 Jul 24 15:59:58 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3433f8c-32cc-4c47-8d0c-dcbb823d4947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:58 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Volume volume-05d82ea2-8e38-4b05-b1ca-098390820da8 (05d82ea2-8e38-4b05-b1ca-098390820da8): created successfully Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3433f8c-32cc-4c47-8d0c-dcbb823d4947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Flow 'volume_create_manager' (5bb3fe36-d442-4e10-9c4b-56c9b3483f20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:58 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-03af5c57-b950-4b89-952a-83d9930f9708 tempest-CreateVolumesFromImageTest-1166947250 None] Created volume successfully. Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:59 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Flow 'volume_create_manager' (e03ee4ff-89f6-448f-a0d0-71b16e996736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6d1379-5f00-4299-b122-7ecc41ca0d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4 1073741824" returned: 0 in 0.501s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d6d1379-5f00-4299-b122-7ecc41ca0d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-216808457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09139bb-3fe0-4848-929f-e375a2943273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa272c8dfb43b1bbf6c091e571106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:59Z,use_quota=True,user_id='973103f8438c4b9ca571ac96e748cc03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa20c113-1021-4ad7-9007-997c63ed28ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa20c113-1021-4ad7-9007-997c63ed28ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81e7578-bc0c-4c56-b5a5-7df1bc2b6870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f81e7578-bc0c-4c56-b5a5-7df1bc2b6870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f09139bb-3fe0-4848-929f-e375a2943273', 'volume_name': 'volume-f09139bb-3fe0-4848-929f-e375a2943273', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c2909f-8f5c-44bb-bc83-04a86be6d052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c2909f-8f5c-44bb-bc83-04a86be6d052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2dae24-82e4-44db-a8a3-85481742c3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Volume f09139bb-3fe0-4848-929f-e375a2943273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f09139bb-3fe0-4848-929f-e375a2943273', 'volume_size': 1} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:59 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4 Jul 24 15:59:59 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Flow 'volume_create_manager' (ceea2fb4-4936-4643-a5d8-78a634290752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:59 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7920da4f-4373-49cb-a837-d8ec8896657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4" returned: 0 in 0.291s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.954s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1498651615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b3f2c3-5034-4949-93e2-82c6f9b680f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa272c8dfb43b1bbf6c091e571106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:59Z,use_quota=True,user_id='973103f8438c4b9ca571ac96e748cc03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Creating volume 72b3f2c3-5034-4949-93e2-82c6f9b680f0 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 15:59:59 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7920da4f-4373-49cb-a837-d8ec8896657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2015182273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009a49f8-5378-4392-9c4c-1804737ea443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa272c8dfb43b1bbf6c091e571106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:00Z,use_quota=True,user_id='973103f8438c4b9ca571ac96e748cc03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:59 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0 1073741824 Jul 24 15:59:59 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a663f4-3cc4-4175-94f4-473b20bc3fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a663f4-3cc4-4175-94f4-473b20bc3fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affca8e5-0e1b-44d9-9c66-1c188769b098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (affca8e5-0e1b-44d9-9c66-1c188769b098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '009a49f8-5378-4392-9c4c-1804737ea443', 'volume_name': 'volume-009a49f8-5378-4392-9c4c-1804737ea443', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382aa48b-af70-4e3e-b87b-52abe2d9dc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (382aa48b-af70-4e3e-b87b-52abe2d9dc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5774c43a-2caf-4bb2-ad70-85f76804e68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Volume 009a49f8-5378-4392-9c4c-1804737ea443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-009a49f8-5378-4392-9c4c-1804737ea443', 'volume_size': 1} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0723a4de-9528-4f38-81c5-9b7f939a517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871721f9-8b02-402d-92f3-009e76749a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 15:59:59 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Volume volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4 (025345e2-b4a3-41f7-aacd-6d6cfd0511a4): created successfully Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (871721f9-8b02-402d-92f3-009e76749a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 15:59:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Flow 'volume_create_manager' (fdd17ca1-ed3b-4ea5-ae20-7ef5e481316c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 15:59:59 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7f0b1cda-0943-4653-bad6-2ec51c2518a9 tempest-CreateVolumesFromImageTest-1166947250 None] Created volume successfully. Jul 24 16:00:00 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0 1073741824" returned: 0 in 0.409s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:00 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0 Jul 24 16:00:00 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:00 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0" returned: 0 in 0.272s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.049s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-216808457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09139bb-3fe0-4848-929f-e375a2943273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa272c8dfb43b1bbf6c091e571106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T13:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T13:59:59Z,use_quota=True,user_id='973103f8438c4b9ca571ac96e748cc03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Creating volume f09139bb-3fe0-4848-929f-e375a2943273 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:00 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f09139bb-3fe0-4848-929f-e375a2943273 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3429df9c-b77f-40f5-967b-69dc1fa8f24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:00 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f09139bb-3fe0-4848-929f-e375a2943273 1073741824 Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a73017b-01d9-4bdb-8b7e-3801419d1047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:00 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:00 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Volume volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0 (72b3f2c3-5034-4949-93e2-82c6f9b680f0): created successfully Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a73017b-01d9-4bdb-8b7e-3801419d1047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Flow 'volume_create_manager' (2535a501-91bd-4edd-be87-2e83fedc7615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:00 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-92cb9352-c3dd-458d-832d-89cf74475336 tempest-CreateVolumesFromImageTest-1166947250 None] Created volume successfully. Jul 24 16:00:00 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f09139bb-3fe0-4848-929f-e375a2943273 1073741824" returned: 0 in 0.478s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f09139bb-3fe0-4848-929f-e375a2943273 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:00 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f09139bb-3fe0-4848-929f-e375a2943273 Jul 24 16:00:00 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:01 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f09139bb-3fe0-4848-929f-e375a2943273" returned: 0 in 0.289s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.466s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T13:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2015182273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009a49f8-5378-4392-9c4c-1804737ea443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baa272c8dfb43b1bbf6c091e571106d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:00Z,use_quota=True,user_id='973103f8438c4b9ca571ac96e748cc03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Creating volume 009a49f8-5378-4392-9c4c-1804737ea443 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:01 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-009a49f8-5378-4392-9c4c-1804737ea443 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2dae24-82e4-44db-a8a3-85481742c3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f09139bb-3fe0-4848-929f-e375a2943273', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:01 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-009a49f8-5378-4392-9c4c-1804737ea443 1073741824 Jul 24 16:00:01 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35fe184c-dd22-453b-b85b-17db18310cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:01 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Volume volume-f09139bb-3fe0-4848-929f-e375a2943273 (f09139bb-3fe0-4848-929f-e375a2943273): created successfully Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35fe184c-dd22-453b-b85b-17db18310cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Flow 'volume_create_manager' (e03ee4ff-89f6-448f-a0d0-71b16e996736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:01 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-227daaae-839e-422a-a7b8-508f36a6e943 tempest-CreateVolumesFromImageTest-1166947250 None] Created volume successfully. Jul 24 16:00:01 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-009a49f8-5378-4392-9c4c-1804737ea443 1073741824" returned: 0 in 0.456s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-009a49f8-5378-4392-9c4c-1804737ea443 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:01 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-009a49f8-5378-4392-9c4c-1804737ea443 Jul 24 16:00:01 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:01 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-009a49f8-5378-4392-9c4c-1804737ea443" returned: 0 in 0.253s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5774c43a-2caf-4bb2-ad70-85f76804e68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-009a49f8-5378-4392-9c4c-1804737ea443', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a152d597-f5e6-4954-9b5b-61aa183f5ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:01 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Volume volume-009a49f8-5378-4392-9c4c-1804737ea443 (009a49f8-5378-4392-9c4c-1804737ea443): created successfully Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a152d597-f5e6-4954-9b5b-61aa183f5ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:01 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Flow 'volume_create_manager' (ceea2fb4-4936-4643-a5d8-78a634290752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:02 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-af800572-180a-40ef-8d0a-d7e88266b472 tempest-CreateVolumesFromImageTest-1166947250 None] Created volume successfully. Jul 24 16:00:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "cinder-009a49f8-5378-4392-9c4c-1804737ea443-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-009a49f8-5378-4392-9c4c-1804737ea443-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "cinder-quobyte-009a49f8-5378-4392-9c4c-1804737ea443" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-quobyte-009a49f8-5378-4392-9c4c-1804737ea443" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[30251937-af13-471d-8c5b-fc3a7a5ff717]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-009a49f8-5378-4392-9c4c-1804737ea443 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:03 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-009a49f8-5378-4392-9c4c-1804737ea443 Jul 24 16:00:03 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:03 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-009a49f8-5378-4392-9c4c-1804737ea443" returned: 0 in 0.370s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-009a49f8-5378-4392-9c4c-1804737ea443 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:03 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-009a49f8-5378-4392-9c4c-1804737ea443 Jul 24 16:00:03 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:03 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-009a49f8-5378-4392-9c4c-1804737ea443" returned: 0 in 0.249s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-quobyte-009a49f8-5378-4392-9c4c-1804737ea443" released by "delete_volume" :: held 0.661s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Created reservations ['e9463697-de67-4da3-a04b-8d74a5693ba8', 'bb0f0606-e8c2-4623-9cda-1f7b9ec73bba', '86ed1624-7558-4994-a881-2f92f0c2998f', 'd81fc355-77e0-45d2-a239-9b0fa343960e'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:03 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:03 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:04 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.244s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:04 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Deleted volume successfully. Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-861b6abe-952b-4a91-9620-8119e21a94b1 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-009a49f8-5378-4392-9c4c-1804737ea443-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "cinder-f09139bb-3fe0-4848-929f-e375a2943273-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-f09139bb-3fe0-4848-929f-e375a2943273-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "cinder-quobyte-f09139bb-3fe0-4848-929f-e375a2943273" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-quobyte-f09139bb-3fe0-4848-929f-e375a2943273" acquired by "delete_volume" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8137ab-3cde-4b44-b479-463ecfd84852]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f09139bb-3fe0-4848-929f-e375a2943273 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:04 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f09139bb-3fe0-4848-929f-e375a2943273 Jul 24 16:00:04 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:04 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f09139bb-3fe0-4848-929f-e375a2943273" returned: 0 in 0.348s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f09139bb-3fe0-4848-929f-e375a2943273 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:04 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f09139bb-3fe0-4848-929f-e375a2943273 Jul 24 16:00:04 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:04 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f09139bb-3fe0-4848-929f-e375a2943273" returned: 0 in 0.239s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-quobyte-f09139bb-3fe0-4848-929f-e375a2943273" released by "delete_volume" :: held 0.627s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Created reservations ['038d68a2-683b-47a2-b4a1-0fdebd5fdeac', 'f3bd3012-bd16-4890-a077-443959c0a9af', '855ae093-1da6-4233-8002-cab8d0c9bb2e', 'dfd410f7-545f-4c79-afa5-30cc308fd93f'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:04 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:04 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:05 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.234s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:05 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:05 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Deleted volume successfully. Jul 24 16:00:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-211382e1-7a6a-4e88-b151-de482de89c3b tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-f09139bb-3fe0-4848-929f-e375a2943273-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "cinder-72b3f2c3-5034-4949-93e2-82c6f9b680f0-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-72b3f2c3-5034-4949-93e2-82c6f9b680f0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "cinder-quobyte-72b3f2c3-5034-4949-93e2-82c6f9b680f0" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-quobyte-72b3f2c3-5034-4949-93e2-82c6f9b680f0" acquired by "delete_volume" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:05 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f2cb4e-39b7-4908-bb28-62831a5b2c50]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:05 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0 Jul 24 16:00:05 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:05 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0" returned: 0 in 0.355s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:05 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0 Jul 24 16:00:05 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:06 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72b3f2c3-5034-4949-93e2-82c6f9b680f0" returned: 0 in 0.244s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-quobyte-72b3f2c3-5034-4949-93e2-82c6f9b680f0" released by "delete_volume" :: held 0.637s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Created reservations ['bb73e389-74d5-42e6-a2ae-0d6f0c31da1c', '08482da3-cbf4-464d-a65c-3752b7dcb744', '74b7f014-4076-4f69-b7e4-1367074be311', '66c840f8-5455-46a4-bda5-0a33acad26cd'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:06 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:06 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:06 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.243s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:06 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Deleted volume successfully. Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e7a8a114-accc-4721-a0ca-b632a8dd9f93 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-72b3f2c3-5034-4949-93e2-82c6f9b680f0-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "cinder-025345e2-b4a3-41f7-aacd-6d6cfd0511a4-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-025345e2-b4a3-41f7-aacd-6d6cfd0511a4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "cinder-quobyte-025345e2-b4a3-41f7-aacd-6d6cfd0511a4" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-quobyte-025345e2-b4a3-41f7-aacd-6d6cfd0511a4" acquired by "delete_volume" :: waited 0.014s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0701505-60bf-4a57-8f77-ee05c2eef792]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:06 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4 Jul 24 16:00:06 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:06 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4" returned: 0 in 0.341s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:06 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4 Jul 24 16:00:06 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:07 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-025345e2-b4a3-41f7-aacd-6d6cfd0511a4" returned: 0 in 0.253s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-quobyte-025345e2-b4a3-41f7-aacd-6d6cfd0511a4" released by "delete_volume" :: held 0.633s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Created reservations ['ef6a0f16-327c-42b9-a6cb-928ebfd4267d', 'a0d8368a-b2e4-4601-abf0-f1c9f008e891', '63db089d-68ec-481f-acb6-8cd75199a216', 'f8625d92-d839-4dd4-ab15-472f6136eb99'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:07 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:07 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:07 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.238s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:07 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Deleted volume successfully. Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-350ac0e8-e6c4-4ab0-971a-426c9537b281 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-025345e2-b4a3-41f7-aacd-6d6cfd0511a4-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "cinder-05d82ea2-8e38-4b05-b1ca-098390820da8-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-05d82ea2-8e38-4b05-b1ca-098390820da8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "cinder-quobyte-05d82ea2-8e38-4b05-b1ca-098390820da8" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-quobyte-05d82ea2-8e38-4b05-b1ca-098390820da8" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[833adb9d-1861-4877-95bc-8a23952f1fe9]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-05d82ea2-8e38-4b05-b1ca-098390820da8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:07 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-05d82ea2-8e38-4b05-b1ca-098390820da8 Jul 24 16:00:07 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:08 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-05d82ea2-8e38-4b05-b1ca-098390820da8" returned: 0 in 0.379s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-05d82ea2-8e38-4b05-b1ca-098390820da8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:08 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-05d82ea2-8e38-4b05-b1ca-098390820da8 Jul 24 16:00:08 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:08 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-05d82ea2-8e38-4b05-b1ca-098390820da8" returned: 0 in 0.238s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-quobyte-05d82ea2-8e38-4b05-b1ca-098390820da8" released by "delete_volume" :: held 0.654s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:08 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Created reservations ['4fce6e50-b494-4897-b288-9dabc60e7cad', '4a39d8e2-c58f-431b-9ada-750bc4ec141a', 'a5e92240-9766-4ed2-8fef-82c8328d3603', '12291267-a06b-4ce3-a655-a1dea1724399'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:08 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:08 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:08 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.249s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:08 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:08 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Deleted volume successfully. Jul 24 16:00:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4a51662e-6a29-42df-a82b-1344bbb44089 tempest-CreateVolumesFromImageTest-1166947250 None] Lock "cinder-05d82ea2-8e38-4b05-b1ca-098390820da8-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Flow 'volume_create_manager' (b129d827-7bf8-4b20-833a-ebfb564b1fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9432c94-dbd8-4ec7-a578-db78057810e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9432c94-dbd8-4ec7-a578-db78057810e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-915052042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0dc70b9-a9c6-4542-aeaf-95df3a187f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf571aeee4542c3a262a629abe00ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:11Z,use_quota=True,user_id='0b6ef8e324f947349142208d0f41d2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39dd701a-8929-4161-a4be-8ecdb79267fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39dd701a-8929-4161-a4be-8ecdb79267fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5066dea6-7a7f-4ed5-a2bc-329f28209a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5066dea6-7a7f-4ed5-a2bc-329f28209a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0dc70b9-a9c6-4542-aeaf-95df3a187f65', 'volume_name': 'volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9755223a-ec39-43b4-b0bc-000c8e637a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9755223a-ec39-43b4-b0bc-000c8e637a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5350c742-84b3-411d-9ea6-8ebe187b74b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:11 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume d0dc70b9-a9c6-4542-aeaf-95df3a187f65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65', 'volume_size': 1} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-915052042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0dc70b9-a9c6-4542-aeaf-95df3a187f65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf571aeee4542c3a262a629abe00ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:11Z,use_quota=True,user_id='0b6ef8e324f947349142208d0f41d2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Creating volume d0dc70b9-a9c6-4542-aeaf-95df3a187f65 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:11 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:11 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65 1073741824 Jul 24 16:00:11 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:11 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65 1073741824" returned: 0 in 0.407s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:12 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65 Jul 24 16:00:12 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:12 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65" returned: 0 in 0.238s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5350c742-84b3-411d-9ea6-8ebe187b74b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb6f1a7-b7fe-4bf2-80e2-866f0c350e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:12 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65 (d0dc70b9-a9c6-4542-aeaf-95df3a187f65): created successfully Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb6f1a7-b7fe-4bf2-80e2-866f0c350e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Flow 'volume_create_manager' (b129d827-7bf8-4b20-833a-ebfb564b1fe8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:12 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1c2a4398-68fe-4442-914c-e6cebb5d2cab tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Created volume successfully. Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Flow 'volume_create_manager' (b7bae2e2-f564-4130-9846-aaccb484ef42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9763312a-2bd3-45e5-a494-5b8b4b8287b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9763312a-2bd3-45e5-a494-5b8b4b8287b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1113702257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7596bf7-e8bb-490e-83c6-a2aa0226e3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf571aeee4542c3a262a629abe00ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:13Z,use_quota=True,user_id='0b6ef8e324f947349142208d0f41d2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8539cd0-acae-4504-a0a1-91e280f3fd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8539cd0-acae-4504-a0a1-91e280f3fd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c821b006-629f-45f7-b5d9-08e216e21958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c821b006-629f-45f7-b5d9-08e216e21958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7596bf7-e8bb-490e-83c6-a2aa0226e3fd', 'volume_name': 'volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c3bc4d-861c-4bb3-b726-df0f3025ea46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1c3bc4d-861c-4bb3-b726-df0f3025ea46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cc54bf-fd0e-458a-bfcb-e2bdad5c8163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:12 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume f7596bf7-e8bb-490e-83c6-a2aa0226e3fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd', 'volume_size': 1} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1113702257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7596bf7-e8bb-490e-83c6-a2aa0226e3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf571aeee4542c3a262a629abe00ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:13Z,use_quota=True,user_id='0b6ef8e324f947349142208d0f41d2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Creating volume f7596bf7-e8bb-490e-83c6-a2aa0226e3fd {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:12 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:13 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd 1073741824 Jul 24 16:00:13 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Flow 'volume_create_manager' (21a1f296-ac1c-4622-9636-5db753514f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c83b25-74fd-427d-b693-9980f01f7ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51c83b25-74fd-427d-b693-9980f01f7ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1631087274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a219de-e221-4da9-840d-388025b9f32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf571aeee4542c3a262a629abe00ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:13Z,use_quota=True,user_id='0b6ef8e324f947349142208d0f41d2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d489d33-a651-463e-8c8b-dd7dccd2d865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d489d33-a651-463e-8c8b-dd7dccd2d865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e654f2-6c0c-4c67-9a4d-650feb44cb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04e654f2-6c0c-4c67-9a4d-650feb44cb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a219de-e221-4da9-840d-388025b9f32f', 'volume_name': 'volume-36a219de-e221-4da9-840d-388025b9f32f', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89e543b-5fc4-47d6-960f-384992de0705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89e543b-5fc4-47d6-960f-384992de0705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc94fa2f-66df-47ff-9fd6-734bf45885f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume 36a219de-e221-4da9-840d-388025b9f32f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a219de-e221-4da9-840d-388025b9f32f', 'volume_size': 1} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:13 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd 1073741824" returned: 0 in 0.503s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:13 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd Jul 24 16:00:13 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Flow 'volume_create_manager' (a0e716e2-f890-4874-bf33-c6e1f07d817b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8032e102-65b1-4e3f-b464-e3c61970d050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8032e102-65b1-4e3f-b464-e3c61970d050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-670014785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c56fccac-d69f-4e49-b797-b9e5fad25825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf571aeee4542c3a262a629abe00ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:14Z,use_quota=True,user_id='0b6ef8e324f947349142208d0f41d2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08ced3b-2d1a-4fd3-8e69-bee91d51dfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08ced3b-2d1a-4fd3-8e69-bee91d51dfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99958010-d27a-464f-8502-5258166f15c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99958010-d27a-464f-8502-5258166f15c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c56fccac-d69f-4e49-b797-b9e5fad25825', 'volume_name': 'volume-c56fccac-d69f-4e49-b797-b9e5fad25825', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a1b675-af1c-4dd5-8a20-8b911ac47134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a1b675-af1c-4dd5-8a20-8b911ac47134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81705707-d73f-4a1e-8b6d-7a221b7afa25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume c56fccac-d69f-4e49-b797-b9e5fad25825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c56fccac-d69f-4e49-b797-b9e5fad25825', 'volume_size': 1} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:13 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd" returned: 0 in 0.282s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.492s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1631087274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a219de-e221-4da9-840d-388025b9f32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf571aeee4542c3a262a629abe00ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:13Z,use_quota=True,user_id='0b6ef8e324f947349142208d0f41d2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Creating volume 36a219de-e221-4da9-840d-388025b9f32f {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:13 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-36a219de-e221-4da9-840d-388025b9f32f 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cc54bf-fd0e-458a-bfcb-e2bdad5c8163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:13 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-36a219de-e221-4da9-840d-388025b9f32f 1073741824 Jul 24 16:00:13 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1044bf13-56af-4fff-a668-1b02fdbd0235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:13 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd (f7596bf7-e8bb-490e-83c6-a2aa0226e3fd): created successfully Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1044bf13-56af-4fff-a668-1b02fdbd0235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Flow 'volume_create_manager' (b7bae2e2-f564-4130-9846-aaccb484ef42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:13 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e6b5e32d-d4f7-48e7-9648-bb5e74c92f17 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Created volume successfully. Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Flow 'volume_create_manager' (3dc237ea-a42d-4058-a4bf-46258f4192ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeae9cb0-2667-4a46-a997-53455557b4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeae9cb0-2667-4a46-a997-53455557b4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1898609218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44877ed1-c209-4e65-af61-f5c4fd58e7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf571aeee4542c3a262a629abe00ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:14Z,use_quota=True,user_id='0b6ef8e324f947349142208d0f41d2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bbf472-795e-4874-8a3e-bce96cb266ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bbf472-795e-4874-8a3e-bce96cb266ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74483819-498d-45b3-94c3-7ff40db6de6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74483819-498d-45b3-94c3-7ff40db6de6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44877ed1-c209-4e65-af61-f5c4fd58e7e2', 'volume_name': 'volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbb6ca9-7cd3-408e-ab74-32e7f1a6d34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebbb6ca9-7cd3-408e-ab74-32e7f1a6d34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7810ae7a-9fa6-4e8f-92ef-5063a694394a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume 44877ed1-c209-4e65-af61-f5c4fd58e7e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2', 'volume_size': 1} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:14 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-36a219de-e221-4da9-840d-388025b9f32f 1073741824" returned: 0 in 0.524s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Flow 'volume_create_manager' (0cf399db-7db3-446a-89eb-2da180c35d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7ed77e-df7c-4708-adf7-09ce43205e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7ed77e-df7c-4708-adf7-09ce43205e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1651874117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cbabc9-0476-4fcb-a7c7-d5e2057b2820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf571aeee4542c3a262a629abe00ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:14Z,use_quota=True,user_id='0b6ef8e324f947349142208d0f41d2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c8bf73-2da7-4d8c-98ed-aa69d5fcabca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c8bf73-2da7-4d8c-98ed-aa69d5fcabca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0accd087-ef5d-4ebe-bb20-c68de8175411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0accd087-ef5d-4ebe-bb20-c68de8175411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99cbabc9-0476-4fcb-a7c7-d5e2057b2820', 'volume_name': 'volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7a071d-fbc4-43f6-b247-2befdae57212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7a071d-fbc4-43f6-b247-2befdae57212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7913dd-37b1-44a7-b8bd-7e7b07c9468f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume 99cbabc9-0476-4fcb-a7c7-d5e2057b2820: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820', 'volume_size': 1} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-36a219de-e221-4da9-840d-388025b9f32f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:14 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-36a219de-e221-4da9-840d-388025b9f32f Jul 24 16:00:14 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:14 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-36a219de-e221-4da9-840d-388025b9f32f" returned: 0 in 0.253s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.025s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-670014785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c56fccac-d69f-4e49-b797-b9e5fad25825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf571aeee4542c3a262a629abe00ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:14Z,use_quota=True,user_id='0b6ef8e324f947349142208d0f41d2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Creating volume c56fccac-d69f-4e49-b797-b9e5fad25825 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:14 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c56fccac-d69f-4e49-b797-b9e5fad25825 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:14 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c56fccac-d69f-4e49-b797-b9e5fad25825 1073741824 Jul 24 16:00:14 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc94fa2f-66df-47ff-9fd6-734bf45885f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a219de-e221-4da9-840d-388025b9f32f', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5770f8-f182-40ac-8a0c-892f58d65ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:14 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume volume-36a219de-e221-4da9-840d-388025b9f32f (36a219de-e221-4da9-840d-388025b9f32f): created successfully Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df5770f8-f182-40ac-8a0c-892f58d65ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Flow 'volume_create_manager' (21a1f296-ac1c-4622-9636-5db753514f8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:14 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d38c9d51-cb85-470a-b87b-9da88c6f0ed3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Created volume successfully. Jul 24 16:00:15 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c56fccac-d69f-4e49-b797-b9e5fad25825 1073741824" returned: 0 in 0.432s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c56fccac-d69f-4e49-b797-b9e5fad25825 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:15 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c56fccac-d69f-4e49-b797-b9e5fad25825 Jul 24 16:00:15 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:15 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c56fccac-d69f-4e49-b797-b9e5fad25825" returned: 0 in 0.264s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.394s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1898609218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44877ed1-c209-4e65-af61-f5c4fd58e7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf571aeee4542c3a262a629abe00ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:14Z,use_quota=True,user_id='0b6ef8e324f947349142208d0f41d2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Creating volume 44877ed1-c209-4e65-af61-f5c4fd58e7e2 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:15 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:15 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2 1073741824 Jul 24 16:00:15 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81705707-d73f-4a1e-8b6d-7a221b7afa25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c56fccac-d69f-4e49-b797-b9e5fad25825', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b96f2f-1209-40a5-aae3-8f92124a0dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:15 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume volume-c56fccac-d69f-4e49-b797-b9e5fad25825 (c56fccac-d69f-4e49-b797-b9e5fad25825): created successfully Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82b96f2f-1209-40a5-aae3-8f92124a0dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Flow 'volume_create_manager' (a0e716e2-f890-4874-bf33-c6e1f07d817b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:15 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7944a212-fa79-4791-a589-d1ced22efe41 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Created volume successfully. Jul 24 16:00:15 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2 1073741824" returned: 0 in 0.412s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:15 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2 Jul 24 16:00:15 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:16 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2" returned: 0 in 0.244s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.711s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1651874117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cbabc9-0476-4fcb-a7c7-d5e2057b2820,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf571aeee4542c3a262a629abe00ef6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:14Z,use_quota=True,user_id='0b6ef8e324f947349142208d0f41d2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Creating volume 99cbabc9-0476-4fcb-a7c7-d5e2057b2820 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:16 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7810ae7a-9fa6-4e8f-92ef-5063a694394a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:16 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820 1073741824 Jul 24 16:00:16 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a90071f-afeb-49f3-aacf-495566203193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:16 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2 (44877ed1-c209-4e65-af61-f5c4fd58e7e2): created successfully Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a90071f-afeb-49f3-aacf-495566203193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Flow 'volume_create_manager' (3dc237ea-a42d-4058-a4bf-46258f4192ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:16 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7701895a-9281-441b-8cae-6263de2d4602 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Created volume successfully. Jul 24 16:00:16 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820 1073741824" returned: 0 in 0.428s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:16 devstack sudo[107500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820 Jul 24 16:00:16 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:16 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820" returned: 0 in 0.243s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7913dd-37b1-44a7-b8bd-7e7b07c9468f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513cce89-5d33-4ce5-9c5d-2e5335a16c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:16 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Volume volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820 (99cbabc9-0476-4fcb-a7c7-d5e2057b2820): created successfully Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (513cce89-5d33-4ce5-9c5d-2e5335a16c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Flow 'volume_create_manager' (0cf399db-7db3-446a-89eb-2da180c35d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:16 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-9e4c66f7-fedf-4405-97e0-50d75a8cf080 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Created volume successfully. Jul 24 16:00:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "cinder-99cbabc9-0476-4fcb-a7c7-d5e2057b2820-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-99cbabc9-0476-4fcb-a7c7-d5e2057b2820-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "cinder-quobyte-99cbabc9-0476-4fcb-a7c7-d5e2057b2820" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-quobyte-99cbabc9-0476-4fcb-a7c7-d5e2057b2820" acquired by "delete_volume" :: waited 0.013s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:17 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e73bc0-2a61-4a42-ae87-bb0d500ebc07]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:17 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820 Jul 24 16:00:17 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:18 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820" returned: 0 in 0.367s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:18 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820 Jul 24 16:00:18 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:18 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-99cbabc9-0476-4fcb-a7c7-d5e2057b2820" returned: 0 in 0.244s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-quobyte-99cbabc9-0476-4fcb-a7c7-d5e2057b2820" released by "delete_volume" :: held 0.647s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Created reservations ['50428fb1-1b53-4b2b-b041-907d5a31690a', '30401e11-4dbf-4e96-96e8-04ad025016ec', 'fb8e2873-2d84-4994-8e82-2d650afbf411', 'fdbc5914-3608-4e50-ac56-4061b8b7acef'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:18 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:18 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:18 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.252s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:18 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Deleted volume successfully. Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a1784b0f-d00f-41e8-9d4c-78c34ae1a7fe tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-99cbabc9-0476-4fcb-a7c7-d5e2057b2820-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "cinder-44877ed1-c209-4e65-af61-f5c4fd58e7e2-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-44877ed1-c209-4e65-af61-f5c4fd58e7e2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:18 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "cinder-quobyte-44877ed1-c209-4e65-af61-f5c4fd58e7e2" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-quobyte-44877ed1-c209-4e65-af61-f5c4fd58e7e2" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:19 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd63dcf-56e7-4727-8a0a-f31a760990df]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:19 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2 Jul 24 16:00:19 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:19 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2" returned: 0 in 0.352s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:19 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2 Jul 24 16:00:19 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:19 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-44877ed1-c209-4e65-af61-f5c4fd58e7e2" returned: 0 in 0.258s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-quobyte-44877ed1-c209-4e65-af61-f5c4fd58e7e2" released by "delete_volume" :: held 0.649s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:19 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Created reservations ['0e8893cf-d69f-41d8-89cd-6ecc8b6847ef', '3384dbbd-8175-4a6d-a4cb-13b3dada86ec', 'eb58f440-635d-462d-861d-c210a6ca5f8d', '1bb10964-a2a3-45e8-adf8-03ed8a39b859'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:19 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:19 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:20 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.266s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:20 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Deleted volume successfully. Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7aa5eaed-5727-4c0a-9e40-e60d2df8704f tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-44877ed1-c209-4e65-af61-f5c4fd58e7e2-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "cinder-c56fccac-d69f-4e49-b797-b9e5fad25825-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-c56fccac-d69f-4e49-b797-b9e5fad25825-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "cinder-quobyte-c56fccac-d69f-4e49-b797-b9e5fad25825" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-quobyte-c56fccac-d69f-4e49-b797-b9e5fad25825" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[384340d0-1a71-46be-bf4b-e3974cfdc85c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c56fccac-d69f-4e49-b797-b9e5fad25825 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:20 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c56fccac-d69f-4e49-b797-b9e5fad25825 Jul 24 16:00:20 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:20 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c56fccac-d69f-4e49-b797-b9e5fad25825" returned: 0 in 0.359s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c56fccac-d69f-4e49-b797-b9e5fad25825 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:20 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c56fccac-d69f-4e49-b797-b9e5fad25825 Jul 24 16:00:20 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:20 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c56fccac-d69f-4e49-b797-b9e5fad25825" returned: 0 in 0.259s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-quobyte-c56fccac-d69f-4e49-b797-b9e5fad25825" released by "delete_volume" :: held 0.660s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Created reservations ['becfcdcd-8b84-4a08-ad00-94947d4cf814', '3ced96d1-b3ca-4455-a8b9-572a13486b1f', 'fe74c777-c7e4-4590-857b-eea99b116b14', 'f35f6f48-9ca9-47f9-b7b6-8fb534716f14'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:20 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:20 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:21 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.266s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:21 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:21 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Deleted volume successfully. Jul 24 16:00:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-960b2361-f5f2-4e88-9a6c-2260e42ab5d0 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-c56fccac-d69f-4e49-b797-b9e5fad25825-delete_volume" released by "delete_volume" :: held 1.129s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "cinder-36a219de-e221-4da9-840d-388025b9f32f-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-36a219de-e221-4da9-840d-388025b9f32f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "cinder-quobyte-36a219de-e221-4da9-840d-388025b9f32f" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-quobyte-36a219de-e221-4da9-840d-388025b9f32f" acquired by "delete_volume" :: waited 0.014s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:21 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f6a719-df6d-40e0-a019-2edec88b8618]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-36a219de-e221-4da9-840d-388025b9f32f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:21 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-36a219de-e221-4da9-840d-388025b9f32f Jul 24 16:00:21 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:21 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-36a219de-e221-4da9-840d-388025b9f32f" returned: 0 in 0.364s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-36a219de-e221-4da9-840d-388025b9f32f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:21 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-36a219de-e221-4da9-840d-388025b9f32f Jul 24 16:00:21 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:22 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-36a219de-e221-4da9-840d-388025b9f32f" returned: 0 in 0.259s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-quobyte-36a219de-e221-4da9-840d-388025b9f32f" released by "delete_volume" :: held 0.662s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Created reservations ['9da8091e-d09a-49f9-a6a3-d98c04ce32d7', 'a74e0c99-9367-428d-ac04-60f34723f0ba', '5bee2665-be87-4841-a2a6-8da99cb3b5d7', 'db1bccf6-24ba-42b5-9f86-6315ad4e0246'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:22 devstack sudo[107545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:22 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:22 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.248s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:22 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Deleted volume successfully. Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-da842e8d-9cfa-42db-8a69-bfea7202c5f3 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-36a219de-e221-4da9-840d-388025b9f32f-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "cinder-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "cinder-quobyte-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-quobyte-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd" acquired by "delete_volume" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd39d1fe-1613-4425-b136-a4dd31a9d5d3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:22 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd Jul 24 16:00:22 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:22 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd" returned: 0 in 0.350s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:22 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd Jul 24 16:00:22 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:23 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd" returned: 0 in 0.253s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-quobyte-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd" released by "delete_volume" :: held 0.639s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Created reservations ['506c130e-60cc-4239-b5c4-f2d547aaf091', '9653cb33-3dae-4d18-8ba3-4e30634916eb', '91c62270-5189-4ad2-b796-e8f007a3ee26', '8aa1fab9-9dc9-48f6-8878-4f0c8cb8d8e7'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:23 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:23 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:23 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.263s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:23 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Deleted volume successfully. Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-807d9494-2831-4443-9680-349fa72c74cf tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-f7596bf7-e8bb-490e-83c6-a2aa0226e3fd-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "cinder-d0dc70b9-a9c6-4542-aeaf-95df3a187f65-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-d0dc70b9-a9c6-4542-aeaf-95df3a187f65-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "cinder-quobyte-d0dc70b9-a9c6-4542-aeaf-95df3a187f65" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-quobyte-d0dc70b9-a9c6-4542-aeaf-95df3a187f65" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3e4b10-224d-4435-8b40-c84836d2bef4]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:23 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65 Jul 24 16:00:23 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:24 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65" returned: 0 in 0.345s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:24 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65 Jul 24 16:00:24 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:24 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d0dc70b9-a9c6-4542-aeaf-95df3a187f65" returned: 0 in 0.242s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-quobyte-d0dc70b9-a9c6-4542-aeaf-95df3a187f65" released by "delete_volume" :: held 0.625s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:24 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Created reservations ['beaad466-9c54-4d07-a599-4d0e2a72d524', 'c7124a42-69f7-49f9-8c2c-2319b900a5d5', '54d4963a-d0b3-4d86-ad92-c57e25a518b5', '76e73911-b8f9-45c2-9436-f237c8eefe4f'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:24 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:24 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:24 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.234s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:24 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:24 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Deleted volume successfully. Jul 24 16:00:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-86ca15e7-5b76-4492-a870-0af63331a4a6 tempest-CreateVolumesFromSourceVolumeTest-1586070436 None] Lock "cinder-d0dc70b9-a9c6-4542-aeaf-95df3a187f65-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Flow 'volume_create_manager' (e5109eec-02fc-44cf-95e6-5a023cbe3b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f55a1c-4d84-447a-9071-a0e16f3b0db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f55a1c-4d84-447a-9071-a0e16f3b0db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9590ff12-9a37-4493-a482-0dcff92702a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ad6ce4fec440958e021cdfff2102bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:27Z,use_quota=True,user_id='93a6a5eb2bf3449fbf6c299d9d428be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e9b360-61cb-4f08-aea7-4a4e974fd7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e9b360-61cb-4f08-aea7-4a4e974fd7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f67835-0f9e-4747-9047-a03b217f36df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f67835-0f9e-4747-9047-a03b217f36df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9590ff12-9a37-4493-a482-0dcff92702a6', 'volume_name': 'volume-9590ff12-9a37-4493-a482-0dcff92702a6', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5becca4-4530-4b61-954c-3c0954eac7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5becca4-4530-4b61-954c-3c0954eac7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a211db-111c-4271-bfc5-4e6a68444b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:27 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Volume 9590ff12-9a37-4493-a482-0dcff92702a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9590ff12-9a37-4493-a482-0dcff92702a6', 'volume_size': 1} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9590ff12-9a37-4493-a482-0dcff92702a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ad6ce4fec440958e021cdfff2102bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:27Z,use_quota=True,user_id='93a6a5eb2bf3449fbf6c299d9d428be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Creating volume 9590ff12-9a37-4493-a482-0dcff92702a6 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:27 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9590ff12-9a37-4493-a482-0dcff92702a6 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:27 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9590ff12-9a37-4493-a482-0dcff92702a6 1073741824 Jul 24 16:00:27 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:27 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9590ff12-9a37-4493-a482-0dcff92702a6 1073741824" returned: 0 in 0.402s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9590ff12-9a37-4493-a482-0dcff92702a6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:28 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9590ff12-9a37-4493-a482-0dcff92702a6 Jul 24 16:00:28 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:28 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9590ff12-9a37-4493-a482-0dcff92702a6" returned: 0 in 0.258s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88a211db-111c-4271-bfc5-4e6a68444b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9590ff12-9a37-4493-a482-0dcff92702a6', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4631fa39-0907-4f56-807c-59aa87c0a70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:28 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Volume volume-9590ff12-9a37-4493-a482-0dcff92702a6 (9590ff12-9a37-4493-a482-0dcff92702a6): created successfully Jul 24 16:00:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4631fa39-0907-4f56-807c-59aa87c0a70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Flow 'volume_create_manager' (e5109eec-02fc-44cf-95e6-5a023cbe3b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:28 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-ada8e76b-2af2-4d61-8c76-a35aa38492d9 tempest-CinderUnicodeTest-1095121494 None] Created volume successfully. Jul 24 16:00:28 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:28 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Flow 'volume_create_manager' (bbe592d1-92f0-46f6-9efe-af536382984a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796acec0-3446-4771-8fd8-46da2a4a138c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (796acec0-3446-4771-8fd8-46da2a4a138c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-146553643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1915afb-0746-4bf1-89f2-f4e02c0e57d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ad6ce4fec440958e021cdfff2102bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:29Z,use_quota=True,user_id='93a6a5eb2bf3449fbf6c299d9d428be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ee29cd-cf36-4b74-aa83-4201bde6d408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ee29cd-cf36-4b74-aa83-4201bde6d408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4a81a4-d116-49fb-a86b-0645f4f6c003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa4a81a4-d116-49fb-a86b-0645f4f6c003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1915afb-0746-4bf1-89f2-f4e02c0e57d5', 'volume_name': 'volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6693ca-f729-433b-9cd3-c93ba6389790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6693ca-f729-433b-9cd3-c93ba6389790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92921b77-085f-4035-9f13-bb443592fbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:29 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Volume a1915afb-0746-4bf1-89f2-f4e02c0e57d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5', 'volume_size': 1} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-146553643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1915afb-0746-4bf1-89f2-f4e02c0e57d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61ad6ce4fec440958e021cdfff2102bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:29Z,use_quota=True,user_id='93a6a5eb2bf3449fbf6c299d9d428be8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Creating volume a1915afb-0746-4bf1-89f2-f4e02c0e57d5 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:29 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:29 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 1073741824 Jul 24 16:00:29 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:29 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 1073741824" returned: 0 in 0.402s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:29 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 Jul 24 16:00:29 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:29 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5" returned: 0 in 0.238s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92921b77-085f-4035-9f13-bb443592fbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288e0fe3-1f10-41a0-b7a6-fcee808c6550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:29 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Volume volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 (a1915afb-0746-4bf1-89f2-f4e02c0e57d5): created successfully Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288e0fe3-1f10-41a0-b7a6-fcee808c6550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:29 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Flow 'volume_create_manager' (bbe592d1-92f0-46f6-9efe-af536382984a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:29 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-6684d62f-b7f8-42bf-a3d1-60cf2eaa4428 tempest-CinderUnicodeTest-1095121494 None] Created volume successfully. Jul 24 16:00:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] Creating offline snapshot f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 of volume a1915afb-0746-4bf1-89f2-f4e02c0e57d5 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:00:30 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1f4b10-ce27-4772-8ee3-741d6a4f6f2c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:30 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 Jul 24 16:00:30 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:30 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5" returned: 0 in 0.346s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:30 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 1G Jul 24 16:00:30 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:30 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 1G" returned: 0 in 0.385s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:30 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 Jul 24 16:00:30 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:31 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58" returned: 0 in 0.282s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:31 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 is being set with open permissions: ugo+rw Jul 24 16:00:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:31 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 Jul 24 16:00:31 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:31 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58" returned: 0 in 0.243s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:31 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.info Jul 24 16:00:31 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:31 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.info" returned: 0 in 0.243s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:31 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.info is being set with open permissions: ugo+rw Jul 24 16:00:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:31 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.info Jul 24 16:00:31 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:32 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.info" returned: 0 in 0.241s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:32 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-fa7ecb85-e229-480e-b943-1d02d5f6b737 tempest-CinderUnicodeTest-1095121494 None] Create snapshot completed successfully Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Acquiring lock "cinder-f1ae6f43-8545-4a75-a5c8-d3d1e9097e58-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Lock "cinder-f1ae6f43-8545-4a75-a5c8-d3d1e9097e58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Acquiring lock "cinder-quobyte-a1915afb-0746-4bf1-89f2-f4e02c0e57d5" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Lock "cinder-quobyte-a1915afb-0746-4bf1-89f2-f4e02c0e57d5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Acquiring lock "cinder-quobyte-f1ae6f43-8545-4a75-a5c8-d3d1e9097e58" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Lock "cinder-quobyte-f1ae6f43-8545-4a75-a5c8-d3d1e9097e58" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Deleting offline snapshot f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 of volume a1915afb-0746-4bf1-89f2-f4e02c0e57d5 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] snapshot_file for this snap is: volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c31703-4c9a-433e-a0ca-87111bddfb75]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:32 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 Jul 24 16:00:32 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:32 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58" returned: 0 in 0.352s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f58e47-10aa-4734-99f5-af3a48d1b07e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:32 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 Jul 24 16:00:32 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:33 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5" returned: 0 in 0.349s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:33 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 Jul 24 16:00:33 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:33 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58" returned: 0 in 0.324s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:33 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58 Jul 24 16:00:33 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:33 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5.f1ae6f43-8545-4a75-a5c8-d3d1e9097e58" returned: 0 in 0.240s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Lock "cinder-quobyte-f1ae6f43-8545-4a75-a5c8-d3d1e9097e58" released by "_delete_snapshot" :: held 1.359s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Lock "cinder-quobyte-a1915afb-0746-4bf1-89f2-f4e02c0e57d5" released by "delete_snapshot" :: held 1.381s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:33 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Created reservations ['0dd5da29-0a91-4417-9bd4-79536716c021', '2b38bb38-277f-42cf-b322-810c25737fdf', '300c8c5c-b24b-4b63-b253-79c38a5616f0', '85c21fbe-099f-4d16-8678-00e353f0c011'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:33 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Delete snapshot completed successfully. Jul 24 16:00:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-71bedba1-ab14-4f12-bfe8-5c0a4d1e0974 tempest-CinderUnicodeTest-1095121494 None] Lock "cinder-f1ae6f43-8545-4a75-a5c8-d3d1e9097e58-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Acquiring lock "cinder-a1915afb-0746-4bf1-89f2-f4e02c0e57d5-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Lock "cinder-a1915afb-0746-4bf1-89f2-f4e02c0e57d5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Acquiring lock "cinder-quobyte-a1915afb-0746-4bf1-89f2-f4e02c0e57d5" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Lock "cinder-quobyte-a1915afb-0746-4bf1-89f2-f4e02c0e57d5" acquired by "delete_volume" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:34 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[df543258-acd6-4a86-8c05-88e664dbfc7a]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:34 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 Jul 24 16:00:34 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:34 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5" returned: 0 in 0.363s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:35 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5 Jul 24 16:00:35 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:35 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-a1915afb-0746-4bf1-89f2-f4e02c0e57d5" returned: 0 in 0.271s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Lock "cinder-quobyte-a1915afb-0746-4bf1-89f2-f4e02c0e57d5" released by "delete_volume" :: held 0.697s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Created reservations ['a33ba42a-1a59-49c3-b450-1223d93e0023', 'e8253931-bb88-47ef-ae8e-a127db6ca115', 'b70e46d1-c882-49fc-bc04-c626bc6ac3dd', '53f12a15-19c7-4fb9-9878-f220adb10120'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:35 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:35 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:35 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.237s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:35 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Deleted volume successfully. Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-fe52aedd-9700-4e21-aee7-c0f011363c63 tempest-CinderUnicodeTest-1095121494 None] Lock "cinder-a1915afb-0746-4bf1-89f2-f4e02c0e57d5-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Acquiring lock "cinder-9590ff12-9a37-4493-a482-0dcff92702a6-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Lock "cinder-9590ff12-9a37-4493-a482-0dcff92702a6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Acquiring lock "cinder-quobyte-9590ff12-9a37-4493-a482-0dcff92702a6" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Lock "cinder-quobyte-9590ff12-9a37-4493-a482-0dcff92702a6" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d437abf9-2b95-41d1-9e8d-0aabad541949]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9590ff12-9a37-4493-a482-0dcff92702a6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:35 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9590ff12-9a37-4493-a482-0dcff92702a6 Jul 24 16:00:35 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:36 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9590ff12-9a37-4493-a482-0dcff92702a6" returned: 0 in 0.347s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9590ff12-9a37-4493-a482-0dcff92702a6 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:36 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9590ff12-9a37-4493-a482-0dcff92702a6 Jul 24 16:00:36 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:36 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-9590ff12-9a37-4493-a482-0dcff92702a6" returned: 0 in 0.240s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:36 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Lock "cinder-quobyte-9590ff12-9a37-4493-a482-0dcff92702a6" released by "delete_volume" :: held 0.628s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:36 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Created reservations ['4d50ff60-e01c-46ce-93ea-a23caa720cef', '912bb190-5a79-48a6-918c-a5ce7f5cfafd', 'ff02ea45-7a10-4b6d-a565-d800a5978987', '4c711b49-9e7d-4f8e-846c-1ead66804dd0'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:36 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:36 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:36 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:36 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:36 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.251s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:36 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:36 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Deleted volume successfully. Jul 24 16:00:36 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-82d36c18-1967-4549-ab5a-3fd5951af252 tempest-CinderUnicodeTest-1095121494 None] Lock "cinder-9590ff12-9a37-4493-a482-0dcff92702a6-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 16:00:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:40 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:40 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:40 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.240s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 16:00:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 16:00:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 16:00:46 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=168,cinder:SELECT=102,cinder:INSERT=44,cinder:DELETE=14 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 16:00:46 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=109,cinder:INSERT=30,cinder:UPDATE=149,cinder:DELETE=14 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Flow 'volume_create_manager' (a41a8495-4ebf-4279-ba83-66b01585f113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd47618-75b2-4fc8-b68e-9f346d2e1e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfd47618-75b2-4fc8-b68e-9f346d2e1e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2072470100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806c30df-3256-4289-8f78-9d72024a2647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9399ad9ef44a6b6d1a89599f11d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:49Z,use_quota=True,user_id='a86d234f7ce547c79946c88b0b9020cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb446a58-4836-4b30-8aae-6cb3d8e881e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb446a58-4836-4b30-8aae-6cb3d8e881e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab06c9ec-f75b-4e17-94b6-710df2280edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab06c9ec-f75b-4e17-94b6-710df2280edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '806c30df-3256-4289-8f78-9d72024a2647', 'volume_name': 'volume-806c30df-3256-4289-8f78-9d72024a2647', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b75816f-a47a-4ef1-af66-bc7a3cffc38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b75816f-a47a-4ef1-af66-bc7a3cffc38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bccc8ee-a948-4e80-ba34-e4148794f3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:49 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Volume 806c30df-3256-4289-8f78-9d72024a2647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-806c30df-3256-4289-8f78-9d72024a2647', 'volume_size': 1} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2072470100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=806c30df-3256-4289-8f78-9d72024a2647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9399ad9ef44a6b6d1a89599f11d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:49Z,use_quota=True,user_id='a86d234f7ce547c79946c88b0b9020cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Creating volume 806c30df-3256-4289-8f78-9d72024a2647 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:49 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:49 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 1073741824 Jul 24 16:00:49 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Flow 'volume_create_manager' (0f296bd5-ec5e-42f3-8908-67f3d169b541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a000934-0410-4760-90dc-9de607b3ce09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a000934-0410-4760-90dc-9de607b3ce09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1125890927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f002a7c4-2d1f-417d-9ac9-cc6720af289e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7abb02df4049719abc44a893a25451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:49Z,use_quota=True,user_id='154dec1c0b264a77ab12990b1dce0573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb674c4-bd88-4d0c-b557-d5bdeb801e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bb674c4-bd88-4d0c-b557-d5bdeb801e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3bf318-ea0c-49be-885a-0a43d14a1cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3bf318-ea0c-49be-885a-0a43d14a1cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f002a7c4-2d1f-417d-9ac9-cc6720af289e', 'volume_name': 'volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52e11dd-4c86-4ea7-b29c-4d6d53b041ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52e11dd-4c86-4ea7-b29c-4d6d53b041ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942ba539-0aa6-48e5-a442-d0a504e9996d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:49 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Volume f002a7c4-2d1f-417d-9ac9-cc6720af289e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e', 'volume_size': 1} Jul 24 16:00:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:50 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 1073741824" returned: 0 in 0.816s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Flow 'volume_create_manager' (725a308a-e28c-497d-9115-2ddb69fd4f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ca43e2-f171-4dcf-a442-72ad89ca1d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ca43e2-f171-4dcf-a442-72ad89ca1d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-580794595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100f2022-ede6-4ce1-8ada-113e2aa824dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7abb02df4049719abc44a893a25451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:50Z,use_quota=True,user_id='154dec1c0b264a77ab12990b1dce0573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:50 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 Jul 24 16:00:50 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78be1c1e-ac09-4c88-b7bb-01fdb202e7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78be1c1e-ac09-4c88-b7bb-01fdb202e7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07f3611-d4de-4450-944c-31481fd26aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07f3611-d4de-4450-944c-31481fd26aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '100f2022-ede6-4ce1-8ada-113e2aa824dc', 'volume_name': 'volume-100f2022-ede6-4ce1-8ada-113e2aa824dc', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e1992d-868f-4ed6-b464-e5ad3f1e0cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8e1992d-868f-4ed6-b464-e5ad3f1e0cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18cc1aaf-d34e-430b-84cc-8576986038c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Volume 100f2022-ede6-4ce1-8ada-113e2aa824dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-100f2022-ede6-4ce1-8ada-113e2aa824dc', 'volume_size': 1} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Flow 'volume_create_manager' (ae3022ad-ba5a-4755-bb90-71a875a02268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59dd5d0f-8ba3-411b-99dd-8917416aa92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59dd5d0f-8ba3-411b-99dd-8917416aa92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1119094136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7abb02df4049719abc44a893a25451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:50Z,use_quota=True,user_id='154dec1c0b264a77ab12990b1dce0573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54305fc-64f5-4217-9f9e-be2b3d84c211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a54305fc-64f5-4217-9f9e-be2b3d84c211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d094a48b-d556-4d46-a6b8-95984bd094fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d094a48b-d556-4d46-a6b8-95984bd094fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e', 'volume_name': 'volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99bce67-4a55-4b7f-8b6f-c455b1f004a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99bce67-4a55-4b7f-8b6f-c455b1f004a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6829b7-7d3e-4c01-a4c9-93d207ebf2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Volume d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e', 'volume_size': 1} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:50 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647" returned: 0 in 0.459s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.251s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1125890927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f002a7c4-2d1f-417d-9ac9-cc6720af289e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7abb02df4049719abc44a893a25451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:49Z,use_quota=True,user_id='154dec1c0b264a77ab12990b1dce0573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Creating volume f002a7c4-2d1f-417d-9ac9-cc6720af289e {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:50 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:50 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e 1073741824 Jul 24 16:00:50 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bccc8ee-a948-4e80-ba34-e4148794f3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-806c30df-3256-4289-8f78-9d72024a2647', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11d7e26-484f-4588-a68b-543582821ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Flow 'volume_create_manager' (803f234a-76f4-47d3-95a7-ed937a225dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc6a1f7-2f93-4b85-b7a0-1e6f56b5c800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Volume volume-806c30df-3256-4289-8f78-9d72024a2647 (806c30df-3256-4289-8f78-9d72024a2647): created successfully Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11d7e26-484f-4588-a68b-543582821ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Flow 'volume_create_manager' (a41a8495-4ebf-4279-ba83-66b01585f113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc6a1f7-2f93-4b85-b7a0-1e6f56b5c800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1651299283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4eb0fd0-c08d-41bc-a7c5-c1de73c83049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7abb02df4049719abc44a893a25451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:51Z,use_quota=True,user_id='154dec1c0b264a77ab12990b1dce0573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a360b02-e1b6-4886-a81a-55b7ac391bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a360b02-e1b6-4886-a81a-55b7ac391bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e0e67d-eae8-4268-9a77-959b07bcfb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e0e67d-eae8-4268-9a77-959b07bcfb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4eb0fd0-c08d-41bc-a7c5-c1de73c83049', 'volume_name': 'volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b66b02-1f20-4e22-a31f-3e6230ca159a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27b66b02-1f20-4e22-a31f-3e6230ca159a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30706795-fcd5-45bd-b0d1-c2328cd3bb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:50 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Volume c4eb0fd0-c08d-41bc-a7c5-c1de73c83049: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049', 'volume_size': 1} Jul 24 16:00:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:50 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a1717e23-11b5-4752-af51-fd8d313359d3 tempest-VolumeDependencyTests-1564625602 None] Created volume successfully. Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Flow 'volume_create_manager' (a1d70d5b-7a09-4b31-95f3-9f8d4dd2ac05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26098643-51bc-4be2-a5fc-ee1a6ddc1504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26098643-51bc-4be2-a5fc-ee1a6ddc1504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-677671052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6270d431-0d48-4dfc-a25b-3f06422109fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7abb02df4049719abc44a893a25451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:51Z,use_quota=True,user_id='154dec1c0b264a77ab12990b1dce0573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee93889-bc84-42dd-88f8-3a5dc07db813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee93889-bc84-42dd-88f8-3a5dc07db813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8613aa-471e-42ea-98ab-557736a5f497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8613aa-471e-42ea-98ab-557736a5f497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6270d431-0d48-4dfc-a25b-3f06422109fe', 'volume_name': 'volume-6270d431-0d48-4dfc-a25b-3f06422109fe', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fc4d74-478d-4706-8554-d1e9308d0e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fc4d74-478d-4706-8554-d1e9308d0e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b267bf-3821-44c5-a49a-b2cd7499de88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:51 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Volume 6270d431-0d48-4dfc-a25b-3f06422109fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6270d431-0d48-4dfc-a25b-3f06422109fe', 'volume_size': 1} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:51 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e 1073741824" returned: 0 in 0.742s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:51 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e Jul 24 16:00:51 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:51 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e" returned: 0 in 0.303s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.496s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-580794595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=100f2022-ede6-4ce1-8ada-113e2aa824dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7abb02df4049719abc44a893a25451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:50Z,use_quota=True,user_id='154dec1c0b264a77ab12990b1dce0573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Creating volume 100f2022-ede6-4ce1-8ada-113e2aa824dc {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:51 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-100f2022-ede6-4ce1-8ada-113e2aa824dc 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:51 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-100f2022-ede6-4ce1-8ada-113e2aa824dc 1073741824 Jul 24 16:00:51 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942ba539-0aa6-48e5-a442-d0a504e9996d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bd8e99-1d16-42f1-b1e6-05cc427a6676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:51 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Volume volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e (f002a7c4-2d1f-417d-9ac9-cc6720af289e): created successfully Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0bd8e99-1d16-42f1-b1e6-05cc427a6676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Flow 'volume_create_manager' (0f296bd5-ec5e-42f3-8908-67f3d169b541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:51 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-6c218500-8d83-4c37-98ce-39586424c933 tempest-CreateVolumesFromImageTest-1221410389 None] Created volume successfully. Jul 24 16:00:52 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-100f2022-ede6-4ce1-8ada-113e2aa824dc 1073741824" returned: 0 in 0.485s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-100f2022-ede6-4ce1-8ada-113e2aa824dc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:52 devstack sudo[107724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-100f2022-ede6-4ce1-8ada-113e2aa824dc Jul 24 16:00:52 devstack sudo[107724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:52 devstack sudo[107724]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-100f2022-ede6-4ce1-8ada-113e2aa824dc" returned: 0 in 0.284s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.124s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1119094136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7abb02df4049719abc44a893a25451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:50Z,use_quota=True,user_id='154dec1c0b264a77ab12990b1dce0573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Creating volume d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:52 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18cc1aaf-d34e-430b-84cc-8576986038c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-100f2022-ede6-4ce1-8ada-113e2aa824dc', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:52 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e 1073741824 Jul 24 16:00:52 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af92be23-ae2a-444c-81e3-20643de1755c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:52 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Volume volume-100f2022-ede6-4ce1-8ada-113e2aa824dc (100f2022-ede6-4ce1-8ada-113e2aa824dc): created successfully Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af92be23-ae2a-444c-81e3-20643de1755c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Flow 'volume_create_manager' (725a308a-e28c-497d-9115-2ddb69fd4f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:52 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-4cac41c4-b8ee-45e1-b5c8-0c0d383c0ced tempest-CreateVolumesFromImageTest-1221410389 None] Created volume successfully. Jul 24 16:00:53 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e 1073741824" returned: 0 in 0.559s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:53 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e Jul 24 16:00:53 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:53 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e" returned: 0 in 0.275s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.627s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1651299283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4eb0fd0-c08d-41bc-a7c5-c1de73c83049,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7abb02df4049719abc44a893a25451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:51Z,use_quota=True,user_id='154dec1c0b264a77ab12990b1dce0573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Creating volume c4eb0fd0-c08d-41bc-a7c5-c1de73c83049 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:53 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:53 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049 1073741824 Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac6829b7-7d3e-4c01-a4c9-93d207ebf2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:53 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9b1704-ea63-4eb4-b7a3-3753fe21aa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:53 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Volume volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e (d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e): created successfully Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c9b1704-ea63-4eb4-b7a3-3753fe21aa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Flow 'volume_create_manager' (ae3022ad-ba5a-4755-bb90-71a875a02268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:53 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3f148999-1ee5-4126-bddf-54f94e861960 tempest-CreateVolumesFromImageTest-1221410389 None] Created volume successfully. Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Flow 'volume_create_manager' (c5d17b29-88d3-4b07-bd35-af6c2f2e3e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13934385-e2a7-4ed5-98c0-61445a3be1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:54 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049 1073741824" returned: 0 in 0.576s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13934385-e2a7-4ed5-98c0-61445a3be1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e0ca18-8e80-4f96-b94e-014bceedb53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f51b681e154811ad242a4c978c3351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:54Z,use_quota=True,user_id='0697f5a1f40141d8b2b61e935196a18e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecbc9174-2316-4b54-b317-419577f8a80e),volume_type_id=ecbc9174-2316-4b54-b317-419577f8a80e)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016c2dca-5d1d-4b11-aa73-36ecf7adb7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (016c2dca-5d1d-4b11-aa73-36ecf7adb7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a28644d-9d7e-4a90-ba8f-08948942afb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.image.glance [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Creating Keystone auth plugin from conf {{(pid=88350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:54 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049 Jul 24 16:00:54 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a28644d-9d7e-4a90-ba8f-08948942afb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '33e0ca18-8e80-4f96-b94e-014bceedb53d', 'volume_name': 'volume-33e0ca18-8e80-4f96-b94e-014bceedb53d', 'volume_size': 1, 'image_id': 'b1cff6f8-ea49-4f33-ba61-7f92ff98840a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1cff6f8-ea49-4f33-ba61-7f92ff98840a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4577265960c7eef9af0f2670ed00e148', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60f51b681e154811ad242a4c978c3351', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b1dbc426a38686adceba02be0fccc89e6dd004c32c71ba243e17804fbdf93d3efe44d1df525b8640dbaff15ddef06c84d03cf3c3148b2a88f922c474474a04a9', 'id': 'b1cff6f8-ea49-4f33-ba61-7f92ff98840a', 'created_at': datetime.datetime(2026, 7, 24, 14, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 14, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1cff6f8-ea49-4f33-ba61-7f92ff98840a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fff078-b95b-4187-9d4e-c62c89f3d419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fff078-b95b-4187-9d4e-c62c89f3d419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d4637b-64f9-44ef-a087-863e70062fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:54 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Volume 33e0ca18-8e80-4f96-b94e-014bceedb53d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-33e0ca18-8e80-4f96-b94e-014bceedb53d', 'volume_size': 1, 'image_id': 'b1cff6f8-ea49-4f33-ba61-7f92ff98840a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1cff6f8-ea49-4f33-ba61-7f92ff98840a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4577265960c7eef9af0f2670ed00e148', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60f51b681e154811ad242a4c978c3351', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b1dbc426a38686adceba02be0fccc89e6dd004c32c71ba243e17804fbdf93d3efe44d1df525b8640dbaff15ddef06c84d03cf3c3148b2a88f922c474474a04a9', 'id': 'b1cff6f8-ea49-4f33-ba61-7f92ff98840a', 'created_at': datetime.datetime(2026, 7, 24, 14, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 14, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1cff6f8-ea49-4f33-ba61-7f92ff98840a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Trying to clone 33e0ca18-8e80-4f96-b94e-014bceedb53d from image b1cff6f8-ea49-4f33-ba61-7f92ff98840a at location (None, [{'url': 'file:///opt/stack/data/glance/images/b1cff6f8-ea49-4f33-ba61-7f92ff98840a', 'metadata': {}}]). {{(pid=88350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 16:00:54 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049" returned: 0 in 0.272s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.110s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-677671052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6270d431-0d48-4dfc-a25b-3f06422109fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7abb02df4049719abc44a893a25451',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:51Z,use_quota=True,user_id='154dec1c0b264a77ab12990b1dce0573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Creating volume 6270d431-0d48-4dfc-a25b-3f06422109fe {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:54 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6270d431-0d48-4dfc-a25b-3f06422109fe 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30706795-fcd5-45bd-b0d1-c2328cd3bb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:54 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6270d431-0d48-4dfc-a25b-3f06422109fe 1073741824 Jul 24 16:00:54 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003a67e3-2e86-47a7-9e97-9f97ae8b69cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:54 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Volume volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049 (c4eb0fd0-c08d-41bc-a7c5-c1de73c83049): created successfully Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (003a67e3-2e86-47a7-9e97-9f97ae8b69cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Flow 'volume_create_manager' (803f234a-76f4-47d3-95a7-ed937a225dd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:54 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-328bb095-4d84-4ab9-bf17-8bf408644aaa tempest-CreateVolumesFromImageTest-1221410389 None] Created volume successfully. Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 16:00:54 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Image download 0.00 MB at 0.00 MB/s Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0a10a0-feee-495e-a554-9554a475f495]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:54 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD Jul 24 16:00:54 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:54 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6270d431-0d48-4dfc-a25b-3f06422109fe 1073741824" returned: 0 in 0.447s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6270d431-0d48-4dfc-a25b-3f06422109fe {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:54 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:54 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6270d431-0d48-4dfc-a25b-3f06422109fe Jul 24 16:00:54 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:55 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD Jul 24 16:00:55 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:55 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6270d431-0d48-4dfc-a25b-3f06422109fe" returned: 0 in 0.265s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.762s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b267bf-3821-44c5-a49a-b2cd7499de88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6270d431-0d48-4dfc-a25b-3f06422109fe', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e7b556-db2b-466f-a12d-650f84d3b070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] Creating offline snapshot 6392d6ab-5e8f-42a7-9b41-894134c69129 of volume 806c30df-3256-4289-8f78-9d72024a2647 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:00:55 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Volume volume-6270d431-0d48-4dfc-a25b-3f06422109fe (6270d431-0d48-4dfc-a25b-3f06422109fe): created successfully Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8e7b556-db2b-466f-a12d-650f84d3b070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Flow 'volume_create_manager' (a1d70d5b-7a09-4b31-95f3-9f8d4dd2ac05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91a63c2-01a6-4ced-980f-1bf94f8a88b4]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:55 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7ef6122f-8854-4485-9af7-72e704639cca tempest-CreateVolumesFromImageTest-1221410389 None] Created volume successfully. Jul 24 16:00:55 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Temporary image b1cff6f8-ea49-4f33-ba61-7f92ff98840a is fetched for user 0697f5a1f40141d8b2b61e935196a18e. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bf1ddd-dfcf-43ca-bae1-7c72cfb64bb9]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:55 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 Jul 24 16:00:55 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:55 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD Jul 24 16:00:55 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:55 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "cinder-6270d431-0d48-4dfc-a25b-3f06422109fe-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647" returned: 0 in 0.450s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-6270d431-0d48-4dfc-a25b-3f06422109fe-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:55 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 1G Jul 24 16:00:55 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:55 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "cinder-quobyte-6270d431-0d48-4dfc-a25b-3f06422109fe" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-quobyte-6270d431-0d48-4dfc-a25b-3f06422109fe" acquired by "delete_volume" :: waited 0.038s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c1e9d8-0ea1-4fc6-b454-cbf3ad61792a]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6270d431-0d48-4dfc-a25b-3f06422109fe {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:56 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD Jul 24 16:00:56 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:56 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6270d431-0d48-4dfc-a25b-3f06422109fe Jul 24 16:00:56 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:56 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:56 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 1G" returned: 0 in 0.617s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-806c30df-3256-4289-8f78-9d72024a2647 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:56 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6270d431-0d48-4dfc-a25b-3f06422109fe" returned: 0 in 0.442s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6270d431-0d48-4dfc-a25b-3f06422109fe {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:56 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-806c30df-3256-4289-8f78-9d72024a2647 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 Jul 24 16:00:56 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:56 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6270d431-0d48-4dfc-a25b-3f06422109fe Jul 24 16:00:56 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:56 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6270d431-0d48-4dfc-a25b-3f06422109fe" returned: 0 in 0.295s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-quobyte-6270d431-0d48-4dfc-a25b-3f06422109fe" released by "delete_volume" :: held 0.808s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:56 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-806c30df-3256-4289-8f78-9d72024a2647 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129" returned: 0 in 0.370s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:56 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 is being set with open permissions: ugo+rw Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:56 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 Jul 24 16:00:56 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Created reservations ['8e2b5f71-5a8e-4b90-b103-e1cd435898b1', 'f997326b-4d23-441c-b9f6-09397f0bd77b', '06e3b961-2b05-447a-8ffe-ad307e483efd', '4a6c7fe1-ab3c-4ee1-8d1b-49599e58899b'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:56 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:56 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "cinder-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:57 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "cinder-quobyte-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129" returned: 0 in 0.380s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-quobyte-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3502fc01-176f-4ecf-990c-c59e0bb98845]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:57 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.info Jul 24 16:00:57 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:57 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.330s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:57 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Deleted volume successfully. Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a5017074-96e3-4854-8b41-d79c36db34ba tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-6270d431-0d48-4dfc-a25b-3f06422109fe-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:57 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049 Jul 24 16:00:57 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:57 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.info" returned: 0 in 0.348s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:57 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.info is being set with open permissions: ugo+rw Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:57 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.info Jul 24 16:00:57 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:57 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049" returned: 0 in 0.509s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:57 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049 Jul 24 16:00:57 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:57 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.info" returned: 0 in 0.285s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.661s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.619s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e0ca18-8e80-4f96-b94e-014bceedb53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f51b681e154811ad242a4c978c3351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:54Z,use_quota=True,user_id='0697f5a1f40141d8b2b61e935196a18e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecbc9174-2316-4b54-b317-419577f8a80e),volume_type_id=ecbc9174-2316-4b54-b317-419577f8a80e)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Creating volume 33e0ca18-8e80-4f96-b94e-014bceedb53d {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:57 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:00:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:57 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d 1073741824 Jul 24 16:00:57 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:57 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a4af7652-a073-494d-a1ef-4397cf5b7bc0 tempest-VolumeDependencyTests-1564625602 None] Create snapshot completed successfully Jul 24 16:00:58 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049" returned: 0 in 0.296s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-quobyte-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049" released by "delete_volume" :: held 0.880s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Created reservations ['4d37f936-52f4-4172-9eac-bb6815105a26', '44dda5ee-e4a3-4253-a8cc-ef3f3fac94ce', '2f0955c1-cd19-4b90-a19a-7fdd9946e881', '00380277-5b17-4abd-98bc-fbc149129cde'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:58 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:58 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "cinder-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "cinder-quobyte-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-quobyte-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bedf42-ca9d-431d-a50d-54831fc04c0c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:58 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e Jul 24 16:00:58 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:58 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d 1073741824" returned: 0 in 0.726s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:58 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.468s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:58 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Deleted volume successfully. Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-5f84f692-79a5-4107-bede-42d8b18d9e25 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-c4eb0fd0-c08d-41bc-a7c5-c1de73c83049-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:58 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d Jul 24 16:00:58 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:58 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e" returned: 0 in 0.510s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:58 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e Jul 24 16:00:59 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:59 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d" returned: 0 in 0.369s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Attempting download of b1cff6f8-ea49-4f33-ba61-7f92ff98840a ((None, [{'url': 'file:///opt/stack/data/glance/images/b1cff6f8-ea49-4f33-ba61-7f92ff98840a', 'metadata': {}}])) to volume 33e0ca18-8e80-4f96-b94e-014bceedb53d. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Flow 'volume_create_manager' (82f56e99-d5a2-4b4f-9d6c-951e057933a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49aaa098-6a42-4739-b352-ed03fb1f9dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d33ba9-d62b-4586-9a2e-d693d32e724c]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_hr7xyyxh {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49aaa098-6a42-4739-b352-ed03fb1f9dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1534858270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba894af-f689-4cf9-bb19-3dfdbcea34e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afd9399ad9ef44a6b6d1a89599f11d1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6392d6ab-5e8f-42a7-9b41-894134c69129,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:00:59Z,use_quota=True,user_id='a86d234f7ce547c79946c88b0b9020cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b13f75-ce1a-4b5a-b355-11823bc8fbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89b13f75-ce1a-4b5a-b355-11823bc8fbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5424de9-9926-4cbd-a7cf-4ae07768cd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5424de9-9926-4cbd-a7cf-4ae07768cd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eba894af-f689-4cf9-bb19-3dfdbcea34e7', 'volume_name': 'volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7', 'volume_size': 1, 'snapshot_id': '6392d6ab-5e8f-42a7-9b41-894134c69129'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c61c74-ad1d-4f8d-b5a5-5d4ccc6d2393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c61c74-ad1d-4f8d-b5a5-5d4ccc6d2393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d700b4b-5b05-4686-a2ab-9428cf33524a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:00:59 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Volume eba894af-f689-4cf9-bb19-3dfdbcea34e7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7', 'volume_size': 1, 'snapshot_id': '6392d6ab-5e8f-42a7-9b41-894134c69129'} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "cinder-quobyte-6392d6ab-5e8f-42a7-9b41-894134c69129-eba894af-f689-4cf9-bb19-3dfdbcea34e7" by "_create_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:59 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e" returned: 0 in 0.330s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-quobyte-6392d6ab-5e8f-42a7-9b41-894134c69129-eba894af-f689-4cf9-bb19-3dfdbcea34e7" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Creating volume eba894af-f689-4cf9-bb19-3dfdbcea34e7 from snapshot 6392d6ab-5e8f-42a7-9b41-894134c69129 {{(pid=88350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "cinder-quobyte-eba894af-f689-4cf9-bb19-3dfdbcea34e7" by "_copy_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-quobyte-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e" released by "delete_volume" :: held 0.908s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:00:59 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_hr7xyyxh Jul 24 16:00:59 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-quobyte-eba894af-f689-4cf9-bb19-3dfdbcea34e7" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] snapshot: 6392d6ab-5e8f-42a7-9b41-894134c69129, volume: eba894af-f689-4cf9-bb19-3dfdbcea34e7, {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[235c8dc0-fad7-4a3b-96eb-8625f3a8528b]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Created reservations ['28699678-923e-4bf8-a174-c1be5d237b40', '9f4da9c8-6efe-4b6a-8f16-ead43794d8d3', 'fb3b3f29-0fb6-4a2d-93b1-b127bbb85d53', '86d3aa3c-f7c6-4155-bd32-d4c9fb422d5b'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:00:59 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 Jul 24 16:00:59 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:59 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_hr7xyyxh" returned: 0 in 0.462s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_hr7xyyxh {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:59 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:00:59 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "cinder-100f2022-ede6-4ce1-8ada-113e2aa824dc-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-100f2022-ede6-4ce1-8ada-113e2aa824dc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "cinder-quobyte-100f2022-ede6-4ce1-8ada-113e2aa824dc" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-quobyte-100f2022-ede6-4ce1-8ada-113e2aa824dc" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c29edf4-c2df-491f-bf80-90a073e81f78]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-100f2022-ede6-4ce1-8ada-113e2aa824dc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:00:59 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_hr7xyyxh Jul 24 16:00:59 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:00:59 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.309s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:00:59 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:00:59 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Deleted volume successfully. Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-60c6b609-b350-4a40-86b5-56c43dd96d6f tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-d5fdbb14-5bb4-4f4b-9bc8-f0dc2ed4de5e-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:00 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-100f2022-ede6-4ce1-8ada-113e2aa824dc Jul 24 16:01:00 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:00 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129" returned: 0 in 0.681s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-806c30df-3256-4289-8f78-9d72024a2647(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Creating direct copy from snapshot {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9baf0da-0cbf-46fc-a8a8-c9788795355a]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:00 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_hr7xyyxh" returned: 1 in 0.480s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_hr7xyyxh' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5f90e9-7416-4322-940a-6b392ab19881]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:00 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 Jul 24 16:01:00 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:00 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD Jul 24 16:01:00 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:00 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-100f2022-ede6-4ce1-8ada-113e2aa824dc" returned: 0 in 0.550s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-100f2022-ede6-4ce1-8ada-113e2aa824dc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:00 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-100f2022-ede6-4ce1-8ada-113e2aa824dc Jul 24 16:01:00 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:00 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:00 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647" returned: 0 in 0.480s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.utils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Path /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7 not found in is_blk_device check {{(pid=88350) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:00 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7 Jul 24 16:01:00 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Flow 'volume_create_manager' (bebca4da-4c12-418a-a90c-7c8890199c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a167c1d-44a3-47dd-a741-984ef1190e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a167c1d-44a3-47dd-a741-984ef1190e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512262220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83c5518-ac10-4f14-b526-5857b225a1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b5e21637d04df088b0277639b84468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:01Z,use_quota=True,user_id='506cc1cd0bb149469c0e3f09b7a9dbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200fe0fc-6f74-434b-9a26-3d5f0f51f6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:00 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD Jul 24 16:01:00 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200fe0fc-6f74-434b-9a26-3d5f0f51f6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88ad14d-540b-45dc-88eb-32bef3b33c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b88ad14d-540b-45dc-88eb-32bef3b33c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c83c5518-ac10-4f14-b526-5857b225a1ee', 'volume_name': 'volume-c83c5518-ac10-4f14-b526-5857b225a1ee', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d4363f-7835-4b33-8a2b-099d1b06337d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d4363f-7835-4b33-8a2b-099d1b06337d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:00 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deaab48f-b23e-420b-a2ec-d677b18f1fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:00 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Volume c83c5518-ac10-4f14-b526-5857b225a1ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c83c5518-ac10-4f14-b526-5857b225a1ee', 'volume_size': 1} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-100f2022-ede6-4ce1-8ada-113e2aa824dc" returned: 0 in 0.339s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-quobyte-100f2022-ede6-4ce1-8ada-113e2aa824dc" released by "delete_volume" :: held 0.941s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Created reservations ['86a89948-6127-400b-93d8-0ecbdace1895', 'f240b42d-2a7f-4738-a261-4caea52fc8c3', 'e90d444f-3f01-413a-bd58-8879ac800698', 'ed480653-6432-4424-ac82-65598ae8d27d'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:00 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:00 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "cinder-f002a7c4-2d1f-417d-9ac9-cc6720af289e-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-f002a7c4-2d1f-417d-9ac9-cc6720af289e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:01 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD" returned: 1 in 0.426s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 16:01:01 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] b1cff6f8-ea49-4f33-ba61-7f92ff98840a was raw, converting to qcow2 {{(pid=88350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 16:01:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "cinder-quobyte-f002a7c4-2d1f-417d-9ac9-cc6720af289e" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:01 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d Jul 24 16:01:01 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-quobyte-f002a7c4-2d1f-417d-9ac9-cc6720af289e" acquired by "delete_volume" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:01 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0868bd-9158-4e9c-828a-b0448d568d38]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:01 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.467s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:01 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:01 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e Jul 24 16:01:01 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:01 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Deleted volume successfully. Jul 24 16:01:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-190afa87-15ba-42af-8107-a44a09ec19fa tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-100f2022-ede6-4ce1-8ada-113e2aa824dc-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:02 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e" returned: 0 in 0.940s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:02 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e Jul 24 16:01:02 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:02 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d" returned: 0 in 1.176s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:02 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b1cff6f8-ea49-4f33-ba61-7f92ff98840a_5t_157gddevstack@QuobyteHD, size 0.00 MB, duration 1.18 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 16:01:02 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 16:01:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:02 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d 1G Jul 24 16:01:02 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:02 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f002a7c4-2d1f-417d-9ac9-cc6720af289e" returned: 0 in 0.762s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-quobyte-f002a7c4-2d1f-417d-9ac9-cc6720af289e" released by "delete_volume" :: held 1.777s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:02 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:02 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Created reservations ['97b914ff-efd2-4720-be53-17641cefb5b0', 'd105a250-bb90-4f60-8a2a-0198883d19f6', 'a415831d-5b2e-4afb-a3e9-43d406dc8b92', '57140491-3d87-4fb0-bbfc-2fa7a1c98b01'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d 1G" returned: 0 in 0.812s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Downloaded image b1cff6f8-ea49-4f33-ba61-7f92ff98840a ((None, [{'url': 'file:///opt/stack/data/glance/images/b1cff6f8-ea49-4f33-ba61-7f92ff98840a', 'metadata': {}}])) to volume 33e0ca18-8e80-4f96-b94e-014bceedb53d successfully. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Temporary image b1cff6f8-ea49-4f33-ba61-7f92ff98840a for user 0697f5a1f40141d8b2b61e935196a18e is deleted. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Marking volume 33e0ca18-8e80-4f96-b94e-014bceedb53d as bootable. {{(pid=88350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Copying metadata from image b1cff6f8-ea49-4f33-ba61-7f92ff98840a to 33e0ca18-8e80-4f96-b94e-014bceedb53d. {{(pid=88350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Creating volume glance metadata for volume 33e0ca18-8e80-4f96-b94e-014bceedb53d backed by image b1cff6f8-ea49-4f33-ba61-7f92ff98840a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b1cff6f8-ea49-4f33-ba61-7f92ff98840a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4577265960c7eef9af0f2670ed00e148', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:03 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:03 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d4637b-64f9-44ef-a087-863e70062fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33e0ca18-8e80-4f96-b94e-014bceedb53d', 'volume_size': 1, 'image_id': 'b1cff6f8-ea49-4f33-ba61-7f92ff98840a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1cff6f8-ea49-4f33-ba61-7f92ff98840a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4577265960c7eef9af0f2670ed00e148', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '60f51b681e154811ad242a4c978c3351', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b1dbc426a38686adceba02be0fccc89e6dd004c32c71ba243e17804fbdf93d3efe44d1df525b8640dbaff15ddef06c84d03cf3c3148b2a88f922c474474a04a9', 'id': 'b1cff6f8-ea49-4f33-ba61-7f92ff98840a', 'created_at': datetime.datetime(2026, 7, 24, 14, 0, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 14, 0, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1cff6f8-ea49-4f33-ba61-7f92ff98840a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e3c42a-b310-4a54-b670-cc24a85d7c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:03 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Volume volume-33e0ca18-8e80-4f96-b94e-014bceedb53d (33e0ca18-8e80-4f96-b94e-014bceedb53d): created successfully Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e3c42a-b310-4a54-b670-cc24a85d7c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Flow 'volume_create_manager' (c5d17b29-88d3-4b07-bd35-af6c2f2e3e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:03 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7e999d59-6c43-491e-8e62-0bca55f7a6fa tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Created volume successfully. Jul 24 16:01:03 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.523s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:03 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Deleted volume successfully. Jul 24 16:01:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3fd56220-19bd-4e5c-ac07-f3add02a7ba1 tempest-CreateVolumesFromImageTest-1221410389 None] Lock "cinder-f002a7c4-2d1f-417d-9ac9-cc6720af289e-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Acquiring lock "cinder-33e0ca18-8e80-4f96-b94e-014bceedb53d-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Lock "cinder-33e0ca18-8e80-4f96-b94e-014bceedb53d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Acquiring lock "cinder-quobyte-33e0ca18-8e80-4f96-b94e-014bceedb53d" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Lock "cinder-quobyte-33e0ca18-8e80-4f96-b94e-014bceedb53d" acquired by "delete_volume" :: waited 0.058s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:04 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[375075ce-a4d5-4cb0-a2e3-dfe7aec49309]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:04 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d Jul 24 16:01:04 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:05 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d" returned: 0 in 1.255s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:05 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d Jul 24 16:01:05 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:06 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7" returned: 0 in 5.545s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe49c51-0b98-4456-9416-e76269340c1d]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:06 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 Jul 24 16:01:06 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:06 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-33e0ca18-8e80-4f96-b94e-014bceedb53d" returned: 0 in 0.494s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Lock "cinder-quobyte-33e0ca18-8e80-4f96-b94e-014bceedb53d" released by "delete_volume" :: held 1.848s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Created reservations ['da922c86-c561-4fe1-bf1d-22d2b9327af2', 'd0413da0-e09f-4a5e-af1c-c941749bbe59', 'efe3db82-b834-4300-a0dc-3c25905c46b7', 'b0a36f87-58e2-4dc7-b4d2-3d05e030ae3a'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:06 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:06 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:06 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.299s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:06 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Deleted volume successfully. Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-9868edfa-f6f3-43fb-88c5-f773906a6a12 tempest-VolumeAndVolumeTypeFromImageTest-628906481 None] Lock "cinder-33e0ca18-8e80-4f96-b94e-014bceedb53d-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:06 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647" returned: 0 in 0.689s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Image conversion details: src /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7 {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 16:01:06 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Converted 1024.00 MB image at 184.61 MB/s Jul 24 16:01:06 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7 is being set with open permissions: ugo+rw Jul 24 16:01:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:06 devstack sudo[107930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7 Jul 24 16:01:06 devstack sudo[107930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:07 devstack sudo[107930]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7" returned: 0 in 0.286s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-quobyte-eba894af-f689-4cf9-bb19-3dfdbcea34e7" released by "_copy_volume_from_snapshot" :: held 7.808s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-quobyte-6392d6ab-5e8f-42a7-9b41-894134c69129-eba894af-f689-4cf9-bb19-3dfdbcea34e7" released by "_create_volume_from_snapshot" :: held 7.845s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.870s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.403s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512262220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83c5518-ac10-4f14-b526-5857b225a1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b5e21637d04df088b0277639b84468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:01Z,use_quota=True,user_id='506cc1cd0bb149469c0e3f09b7a9dbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Creating volume c83c5518-ac10-4f14-b526-5857b225a1ee {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:07 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c83c5518-ac10-4f14-b526-5857b225a1ee 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:07 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c83c5518-ac10-4f14-b526-5857b225a1ee 1073741824 Jul 24 16:01:07 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d700b4b-5b05-4686-a2ab-9428cf33524a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7', 'volume_size': 1, 'snapshot_id': '6392d6ab-5e8f-42a7-9b41-894134c69129'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a23494-4271-4cf9-a809-20de8a506bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:07 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Volume volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7 (eba894af-f689-4cf9-bb19-3dfdbcea34e7): created successfully Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a23494-4271-4cf9-a809-20de8a506bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Flow 'volume_create_manager' (82f56e99-d5a2-4b4f-9d6c-951e057933a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:07 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-34f2a9da-9402-4c99-a24b-a26e6491ec63 tempest-VolumeDependencyTests-1564625602 None] Created volume successfully. Jul 24 16:01:07 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c83c5518-ac10-4f14-b526-5857b225a1ee 1073741824" returned: 0 in 0.504s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c83c5518-ac10-4f14-b526-5857b225a1ee {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:07 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c83c5518-ac10-4f14-b526-5857b225a1ee Jul 24 16:01:07 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:08 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c83c5518-ac10-4f14-b526-5857b225a1ee" returned: 0 in 0.301s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deaab48f-b23e-420b-a2ec-d677b18f1fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c83c5518-ac10-4f14-b526-5857b225a1ee', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47ae3ad-2292-439f-8988-3d88fdb0d2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:08 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Volume volume-c83c5518-ac10-4f14-b526-5857b225a1ee (c83c5518-ac10-4f14-b526-5857b225a1ee): created successfully Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47ae3ad-2292-439f-8988-3d88fdb0d2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Flow 'volume_create_manager' (bebca4da-4c12-418a-a90c-7c8890199c51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:08 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-5577b55f-48f5-466f-8a3f-1b62ba05d067 tempest-ProjectReaderTests-1252339988 None] Created volume successfully. Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "cinder-6392d6ab-5e8f-42a7-9b41-894134c69129-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-6392d6ab-5e8f-42a7-9b41-894134c69129-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "cinder-quobyte-806c30df-3256-4289-8f78-9d72024a2647" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-quobyte-806c30df-3256-4289-8f78-9d72024a2647" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "cinder-quobyte-6392d6ab-5e8f-42a7-9b41-894134c69129" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-quobyte-6392d6ab-5e8f-42a7-9b41-894134c69129" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Deleting offline snapshot 6392d6ab-5e8f-42a7-9b41-894134c69129 of volume 806c30df-3256-4289-8f78-9d72024a2647 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] snapshot_file for this snap is: volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4147d233-047c-4cdc-ad24-a1d0175d2545]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:08 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 Jul 24 16:01:08 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:08 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129" returned: 0 in 0.506s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-806c30df-3256-4289-8f78-9d72024a2647(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e985df10-ad06-46f7-8cc5-c6caff076dba]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Acquiring lock "cinder-c83c5518-ac10-4f14-b526-5857b225a1ee-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Lock "cinder-c83c5518-ac10-4f14-b526-5857b225a1ee-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Acquiring lock "cinder-quobyte-c83c5518-ac10-4f14-b526-5857b225a1ee" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:09 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 Jul 24 16:01:09 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Lock "cinder-quobyte-c83c5518-ac10-4f14-b526-5857b225a1ee" acquired by "delete_volume" :: waited 0.037s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:09 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34e9165-d7e9-4afe-b946-2b95c3ccf99e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c83c5518-ac10-4f14-b526-5857b225a1ee {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:09 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c83c5518-ac10-4f14-b526-5857b225a1ee Jul 24 16:01:09 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:09 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647" returned: 0 in 0.488s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:09 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 Jul 24 16:01:09 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:09 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c83c5518-ac10-4f14-b526-5857b225a1ee" returned: 0 in 0.487s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c83c5518-ac10-4f14-b526-5857b225a1ee {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:09 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c83c5518-ac10-4f14-b526-5857b225a1ee Jul 24 16:01:09 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:09 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129" returned: 0 in 0.496s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:09 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:09 devstack sudo[108002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129 Jul 24 16:01:09 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c83c5518-ac10-4f14-b526-5857b225a1ee" returned: 0 in 0.331s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:09 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Lock "cinder-quobyte-c83c5518-ac10-4f14-b526-5857b225a1ee" released by "delete_volume" :: held 0.881s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:10 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Created reservations ['85e9c4a7-3dc3-4533-8448-d4f6b7030bbd', '2655174a-4cdb-4a04-b245-7ad1f014ca1d', '54eae189-9dc7-49bc-a941-75bee25eaa0d', '54fa7e3c-abf9-46bd-90e3-f88dbb6e9131'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:10 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:10 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:10 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647.6392d6ab-5e8f-42a7-9b41-894134c69129" returned: 0 in 0.344s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:10 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-quobyte-6392d6ab-5e8f-42a7-9b41-894134c69129" released by "_delete_snapshot" :: held 1.991s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:10 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-quobyte-806c30df-3256-4289-8f78-9d72024a2647" released by "delete_snapshot" :: held 2.032s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:10 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Created reservations ['b30e6df7-2bea-49e2-8c36-7f41e5e208f6', 'f71f12ef-7682-4cd2-a4fa-b4b300f7606a', '2604d19d-e78a-43b0-baed-010d19dbc042', '7348c155-9685-4cc9-9296-a11bdf5904aa'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:10 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Delete snapshot completed successfully. Jul 24 16:01:10 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-edb2061c-d301-441f-ad6e-94c5c2f46f30 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-6392d6ab-5e8f-42a7-9b41-894134c69129-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:10 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.404s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:10 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:10 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Deleted volume successfully. Jul 24 16:01:10 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e3203f19-6ef7-4729-b65d-b9022a3498ca tempest-ProjectReaderTests-1252339988 None] Lock "cinder-c83c5518-ac10-4f14-b526-5857b225a1ee-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "cinder-806c30df-3256-4289-8f78-9d72024a2647-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-806c30df-3256-4289-8f78-9d72024a2647-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "cinder-quobyte-806c30df-3256-4289-8f78-9d72024a2647" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-quobyte-806c30df-3256-4289-8f78-9d72024a2647" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:11 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3f5101-92bd-4041-bfaf-70e56e79fb3a]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:12 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 Jul 24 16:01:12 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Flow 'volume_create_manager' (0eaddf01-3b15-4906-8276-67fb063e783c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8fb501-cc2b-4407-83e1-ee79d3bd18f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Flow 'volume_create_manager' (872fd30d-4412-4ad6-b5bb-7bf17015647c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760f21f5-ebb3-4180-a262-886275f7225b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8fb501-cc2b-4407-83e1-ee79d3bd18f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1155696435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee243ab5-49b3-48d2-8e53-30676bc8382b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b5e21637d04df088b0277639b84468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:12Z,use_quota=True,user_id='506cc1cd0bb149469c0e3f09b7a9dbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c22a436-4649-4a15-b924-a6e23bef0fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c22a436-4649-4a15-b924-a6e23bef0fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2a55ad-06d0-41c7-baca-d9479fbd87e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2a55ad-06d0-41c7-baca-d9479fbd87e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee243ab5-49b3-48d2-8e53-30676bc8382b', 'volume_name': 'volume-ee243ab5-49b3-48d2-8e53-30676bc8382b', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26d959c-565b-4dbf-9e60-461b2fa9428d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f26d959c-565b-4dbf-9e60-461b2fa9428d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1537b81-9e1f-4b46-b0b9-5cd82432e7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:12 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Volume ee243ab5-49b3-48d2-8e53-30676bc8382b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee243ab5-49b3-48d2-8e53-30676bc8382b', 'volume_size': 1} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1155696435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee243ab5-49b3-48d2-8e53-30676bc8382b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b5e21637d04df088b0277639b84468',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:12Z,use_quota=True,user_id='506cc1cd0bb149469c0e3f09b7a9dbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Creating volume ee243ab5-49b3-48d2-8e53-30676bc8382b {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:12 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ee243ab5-49b3-48d2-8e53-30676bc8382b 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (760f21f5-ebb3-4180-a262-886275f7225b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b53425db-4ae5-4619-a824-dc18cd6a11ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19a5e6c4b58498abf9d05835b3e24cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:12Z,use_quota=True,user_id='4e824fb7855d4e8b8f8a00228e04b6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdff5816-5f81-4e45-9b0d-9bed12d9f552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdff5816-5f81-4e45-9b0d-9bed12d9f552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:12 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ee243ab5-49b3-48d2-8e53-30676bc8382b 1073741824 Jul 24 16:01:12 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (753ee89f-5b92-49e8-8748-51d4c6562aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.image.glance [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Creating Keystone auth plugin from conf {{(pid=88350) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 24 16:01:12 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647" returned: 0 in 0.471s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:12 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647 Jul 24 16:01:12 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (753ee89f-5b92-49e8-8748-51d4c6562aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b53425db-4ae5-4619-a824-dc18cd6a11ec', 'volume_name': 'volume-b53425db-4ae5-4619-a824-dc18cd6a11ec', 'volume_size': 1, 'image_id': 'afd87699-7215-49c9-9768-f09611649949', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/afd87699-7215-49c9-9768-f09611649949', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '18fadbafd98222af0b57ab20d1769c15', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd19a5e6c4b58498abf9d05835b3e24cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bb0ce020390b12d385e1bd59629b1f2f3ad9667acccf90f99b0cd97a299e6f99e73e82d9765cbb039ed241488c3ff2267d6752438fe93ec99e1f2668d70059d9', 'id': 'afd87699-7215-49c9-9768-f09611649949', 'created_at': datetime.datetime(2026, 7, 24, 14, 1, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 14, 1, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afd87699-7215-49c9-9768-f09611649949/file', 'properties': {}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebac62b-995b-4853-9efc-ae6d4b2a778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ebac62b-995b-4853-9efc-ae6d4b2a778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e34656f-c437-443a-9482-fe44fc444be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:12 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Volume b53425db-4ae5-4619-a824-dc18cd6a11ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b53425db-4ae5-4619-a824-dc18cd6a11ec', 'volume_size': 1, 'image_id': 'afd87699-7215-49c9-9768-f09611649949', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/afd87699-7215-49c9-9768-f09611649949', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '18fadbafd98222af0b57ab20d1769c15', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd19a5e6c4b58498abf9d05835b3e24cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bb0ce020390b12d385e1bd59629b1f2f3ad9667acccf90f99b0cd97a299e6f99e73e82d9765cbb039ed241488c3ff2267d6752438fe93ec99e1f2668d70059d9', 'id': 'afd87699-7215-49c9-9768-f09611649949', 'created_at': datetime.datetime(2026, 7, 24, 14, 1, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 14, 1, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afd87699-7215-49c9-9768-f09611649949/file', 'properties': {}}, 'image_service': } Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Trying to clone b53425db-4ae5-4619-a824-dc18cd6a11ec from image afd87699-7215-49c9-9768-f09611649949 at location (None, [{'url': 'file:///opt/stack/data/glance/images/afd87699-7215-49c9-9768-f09611649949', 'metadata': {}}]). {{(pid=88350) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 24 16:01:12 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-806c30df-3256-4289-8f78-9d72024a2647" returned: 0 in 0.380s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-quobyte-806c30df-3256-4289-8f78-9d72024a2647" released by "delete_volume" :: held 0.925s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:12 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ee243ab5-49b3-48d2-8e53-30676bc8382b 1073741824" returned: 0 in 0.592s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Flow 'volume_create_manager' (89eb376f-cec2-4134-91c9-f19cd00b9338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecee323-c531-4db7-9f8a-3c7a578829ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ecee323-c531-4db7-9f8a-3c7a578829ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-318519992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c21b05e-5295-4e58-a428-34a2d134ead5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677136daa4fb46dfa991d9d2744939df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:13Z,use_quota=True,user_id='94779bca900e425bb8d91c3f4053b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700302e9-3217-4147-90b0-394c27169062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700302e9-3217-4147-90b0-394c27169062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3a5e1c-7fe4-417e-8ef0-37a372ee7d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3a5e1c-7fe4-417e-8ef0-37a372ee7d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c21b05e-5295-4e58-a428-34a2d134ead5', 'volume_name': 'volume-7c21b05e-5295-4e58-a428-34a2d134ead5', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fec7ce0-e11d-4ff9-9fa8-0b90321b3a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fec7ce0-e11d-4ff9-9fa8-0b90321b3a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93eed0c7-c7d0-4fdd-a01e-38083be74e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:12 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume 7c21b05e-5295-4e58-a428-34a2d134ead5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c21b05e-5295-4e58-a428-34a2d134ead5', 'volume_size': 1} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 24 16:01:12 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Image download 0.00 MB at 0.00 MB/s Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ee243ab5-49b3-48d2-8e53-30676bc8382b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:12 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ee243ab5-49b3-48d2-8e53-30676bc8382b Jul 24 16:01:12 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2720ea-0a71-42e7-adb1-f2c279a06d0d]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:12 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Created reservations ['92821e0a-b1fa-4010-8213-efb06decc7f7', '41d7699d-9c2b-4017-8ba7-8634137c972b', '05c6d709-b64d-4483-91fd-38042e92eff9', '187f8b46-5903-4263-a2c9-49230c0b45d7'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:13 devstack sudo[108026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:13 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:13 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD Jul 24 16:01:13 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:13 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ee243ab5-49b3-48d2-8e53-30676bc8382b" returned: 0 in 0.267s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.297s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-318519992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c21b05e-5295-4e58-a428-34a2d134ead5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677136daa4fb46dfa991d9d2744939df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:13Z,use_quota=True,user_id='94779bca900e425bb8d91c3f4053b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Creating volume 7c21b05e-5295-4e58-a428-34a2d134ead5 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:13 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1537b81-9e1f-4b46-b0b9-5cd82432e7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee243ab5-49b3-48d2-8e53-30676bc8382b', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799c75d3-502d-430a-b14b-1c813029d7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:13 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5 1073741824 Jul 24 16:01:13 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:13 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Volume volume-ee243ab5-49b3-48d2-8e53-30676bc8382b (ee243ab5-49b3-48d2-8e53-30676bc8382b): created successfully Jul 24 16:01:13 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799c75d3-502d-430a-b14b-1c813029d7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:13 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Flow 'volume_create_manager' (0eaddf01-3b15-4906-8276-67fb063e783c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.307s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:13 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Deleted volume successfully. Jul 24 16:01:13 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f03d0146-990b-4ef8-8f2e-203fb8ef69c4 tempest-ProjectReaderTests-1252339988 None] Created volume successfully. Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2d4140d7-3b99-4867-95ff-10bc0015d787 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-806c30df-3256-4289-8f78-9d72024a2647-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:13 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD Jul 24 16:01:13 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:13 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Temporary image afd87699-7215-49c9-9768-f09611649949 is fetched for user 4e824fb7855d4e8b8f8a00228e04b6c7. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 24 16:01:13 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5 1073741824" returned: 0 in 0.503s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:13 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5 Jul 24 16:01:13 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2af987-8e30-4365-b364-4863432721a5]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Acquiring lock "cinder-ee243ab5-49b3-48d2-8e53-30676bc8382b-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:13 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD Jul 24 16:01:13 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Lock "cinder-ee243ab5-49b3-48d2-8e53-30676bc8382b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:13 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Acquiring lock "cinder-quobyte-ee243ab5-49b3-48d2-8e53-30676bc8382b" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Lock "cinder-quobyte-ee243ab5-49b3-48d2-8e53-30676bc8382b" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "cinder-eba894af-f689-4cf9-bb19-3dfdbcea34e7-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-eba894af-f689-4cf9-bb19-3dfdbcea34e7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[542cca21-6ffb-44d6-8fcc-f21179509db2]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ee243ab5-49b3-48d2-8e53-30676bc8382b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:14 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5" returned: 0 in 0.361s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93eed0c7-c7d0-4fdd-a01e-38083be74e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c21b05e-5295-4e58-a428-34a2d134ead5', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814f38ba-7e56-4a94-be5e-29f29ccee3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "cinder-quobyte-eba894af-f689-4cf9-bb19-3dfdbcea34e7" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:14 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume volume-7c21b05e-5295-4e58-a428-34a2d134ead5 (7c21b05e-5295-4e58-a428-34a2d134ead5): created successfully Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (814f38ba-7e56-4a94-be5e-29f29ccee3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Flow 'volume_create_manager' (89eb376f-cec2-4134-91c9-f19cd00b9338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-quobyte-eba894af-f689-4cf9-bb19-3dfdbcea34e7" acquired by "delete_volume" :: waited 0.039s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:14 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD" returned: 0 in 0.415s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:14 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-6b1a8458-58e6-41e6-a841-3c9bde1252b1 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Created volume successfully. Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:14 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ee243ab5-49b3-48d2-8e53-30676bc8382b Jul 24 16:01:14 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f944172-ceee-4b1c-9491-2594d394d7af]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:14 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD Jul 24 16:01:14 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:14 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7 Jul 24 16:01:14 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:14 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ee243ab5-49b3-48d2-8e53-30676bc8382b" returned: 0 in 0.406s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ee243ab5-49b3-48d2-8e53-30676bc8382b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:14 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ee243ab5-49b3-48d2-8e53-30676bc8382b Jul 24 16:01:14 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:14 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b53425db-4ae5-4619-a824-dc18cd6a11ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d19a5e6c4b58498abf9d05835b3e24cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:12Z,use_quota=True,user_id='4e824fb7855d4e8b8f8a00228e04b6c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Creating volume b53425db-4ae5-4619-a824-dc18cd6a11ec {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:14 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:14 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec 1073741824 Jul 24 16:01:14 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:14 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7" returned: 0 in 0.403s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:14 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7 Jul 24 16:01:14 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:14 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ee243ab5-49b3-48d2-8e53-30676bc8382b" returned: 0 in 0.282s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Lock "cinder-quobyte-ee243ab5-49b3-48d2-8e53-30676bc8382b" released by "delete_volume" :: held 0.766s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Created reservations ['5398e2f9-07ee-4857-98b3-c9f9b1919858', '64ac5e42-38df-41d8-adfe-c729af795d28', '53d55030-df75-4031-8590-95b79ca6293f', 'a6425b7e-1e62-4a51-8a5e-97f68e1eb31d'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:14 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-eba894af-f689-4cf9-bb19-3dfdbcea34e7" returned: 0 in 0.275s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-quobyte-eba894af-f689-4cf9-bb19-3dfdbcea34e7" released by "delete_volume" :: held 0.735s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:14 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:14 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Created reservations ['179917ae-63f8-4efd-a0a8-e848d9ec7b43', '97d1aaab-e878-431d-855d-5d529c271dc0', '8cb999c2-1a19-4af3-9634-7af8dff32fbd', '8d28caff-9ba9-4769-89c8-b1cb1b3c18d5'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:15 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:15 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:15 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec 1073741824" returned: 0 in 0.632s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:15 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec Jul 24 16:01:15 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:15 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.395s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:15 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Deleted volume successfully. Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-19219105-9d16-41da-bf8b-441c18810c1b tempest-ProjectReaderTests-1252339988 None] Lock "cinder-ee243ab5-49b3-48d2-8e53-30676bc8382b-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:15 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.408s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:15 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Deleted volume successfully. Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-66daa855-1768-4bbc-8c0c-7957dd2f1db1 tempest-VolumeDependencyTests-1564625602 None] Lock "cinder-eba894af-f689-4cf9-bb19-3dfdbcea34e7-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:15 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec" returned: 0 in 0.363s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.536s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Creating offline snapshot b34e8514-b309-42cf-a6ac-4b14fcb6be3d of volume 7c21b05e-5295-4e58-a428-34a2d134ead5 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Attempting download of afd87699-7215-49c9-9768-f09611649949 ((None, [{'url': 'file:///opt/stack/data/glance/images/afd87699-7215-49c9-9768-f09611649949', 'metadata': {}}])) to volume b53425db-4ae5-4619-a824-dc18cd6a11ec. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ec7b2e-12cd-4dab-bc03-000fca957012]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dd671f-4030-436d-8437-cead8933f79a]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_afd87699-7215-49c9-9768-f09611649949_bk_f96j1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:15 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5 Jul 24 16:01:15 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:15 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_afd87699-7215-49c9-9768-f09611649949_bk_f96j1 Jul 24 16:01:15 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:16 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5" returned: 0 in 0.467s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:16 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_afd87699-7215-49c9-9768-f09611649949_bk_f96j1" returned: 0 in 0.424s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afd87699-7215-49c9-9768-f09611649949_bk_f96j1 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:16 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d 1G Jul 24 16:01:16 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:16 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afd87699-7215-49c9-9768-f09611649949_bk_f96j1 Jul 24 16:01:16 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:16 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afd87699-7215-49c9-9768-f09611649949_bk_f96j1" returned: 1 in 0.428s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_afd87699-7215-49c9-9768-f09611649949_bk_f96j1' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 16:01:16 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[77600793-80aa-4023-ad3e-9ab8f19c555d]: (4, 'raw') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:16 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD Jul 24 16:01:16 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:16 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d 1G" returned: 0 in 0.623s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c21b05e-5295-4e58-a428-34a2d134ead5 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:16 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c21b05e-5295-4e58-a428-34a2d134ead5 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d Jul 24 16:01:16 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:17 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:17 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD Jul 24 16:01:17 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:17 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c21b05e-5295-4e58-a428-34a2d134ead5 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d" returned: 0 in 0.404s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:17 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d is being set with open permissions: ugo+rw Jul 24 16:01:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:17 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d Jul 24 16:01:17 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:17 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d" returned: 0 in 0.276s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:17 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD" returned: 1 in 0.459s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 24 16:01:17 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] afd87699-7215-49c9-9768-f09611649949 was raw, converting to qcow2 {{(pid=88350) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 24 16:01:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:17 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec Jul 24 16:01:17 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:17 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.info Jul 24 16:01:17 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:17 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.info" returned: 0 in 0.293s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:17 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.info is being set with open permissions: ugo+rw Jul 24 16:01:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:17 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.info Jul 24 16:01:17 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:18 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec" returned: 0 in 0.578s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:18 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_afd87699-7215-49c9-9768-f09611649949_6mps04wtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 16:01:18 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Converted 0.00 MB image at 0.00 MB/s Jul 24 16:01:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:18 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec 1G Jul 24 16:01:18 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:18 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.info" returned: 0 in 0.311s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.523s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:18 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3889c727-8d29-4626-874d-59cb0a1e32e4 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Create snapshot completed successfully Jul 24 16:01:18 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec 1G" returned: 0 in 0.362s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:18 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Downloaded image afd87699-7215-49c9-9768-f09611649949 ((None, [{'url': 'file:///opt/stack/data/glance/images/afd87699-7215-49c9-9768-f09611649949', 'metadata': {}}])) to volume b53425db-4ae5-4619-a824-dc18cd6a11ec successfully. {{(pid=88350) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 24 16:01:18 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Temporary image afd87699-7215-49c9-9768-f09611649949 for user 4e824fb7855d4e8b8f8a00228e04b6c7 is deleted. {{(pid=88350) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 24 16:01:18 devstack cinder-volume[88350]: DEBUG cinder.volume.volume_utils [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Marking volume b53425db-4ae5-4619-a824-dc18cd6a11ec as bootable. {{(pid=88350) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 24 16:01:18 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Copying metadata from image afd87699-7215-49c9-9768-f09611649949 to b53425db-4ae5-4619-a824-dc18cd6a11ec. {{(pid=88350) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 24 16:01:18 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Creating volume glance metadata for volume b53425db-4ae5-4619-a824-dc18cd6a11ec backed by image afd87699-7215-49c9-9768-f09611649949 with: {'image_id': 'afd87699-7215-49c9-9768-f09611649949', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '18fadbafd98222af0b57ab20d1769c15', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88350) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 24 16:01:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e34656f-c437-443a-9482-fe44fc444be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b53425db-4ae5-4619-a824-dc18cd6a11ec', 'volume_size': 1, 'image_id': 'afd87699-7215-49c9-9768-f09611649949', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/afd87699-7215-49c9-9768-f09611649949', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '18fadbafd98222af0b57ab20d1769c15', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd19a5e6c4b58498abf9d05835b3e24cd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bb0ce020390b12d385e1bd59629b1f2f3ad9667acccf90f99b0cd97a299e6f99e73e82d9765cbb039ed241488c3ff2267d6752438fe93ec99e1f2668d70059d9', 'id': 'afd87699-7215-49c9-9768-f09611649949', 'created_at': datetime.datetime(2026, 7, 24, 14, 1, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 24, 14, 1, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/afd87699-7215-49c9-9768-f09611649949/file', 'properties': {}}, 'image_service': }' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56881c26-c0c1-4db2-a6f7-3d0cd8d26149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:18 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Volume volume-b53425db-4ae5-4619-a824-dc18cd6a11ec (b53425db-4ae5-4619-a824-dc18cd6a11ec): created successfully Jul 24 16:01:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56881c26-c0c1-4db2-a6f7-3d0cd8d26149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Flow 'volume_create_manager' (872fd30d-4412-4ad6-b5bb-7bf17015647c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:18 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3425ccc0-75d8-42e4-a019-d98aa5ca64a0 tempest-VolumeImageDependencyTests-627234742 None] Created volume successfully. Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Flow 'volume_create_manager' (2b5ca31b-66b7-4440-9323-737943614332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bddf876-4957-497d-9198-258c98b1af04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bddf876-4957-497d-9198-258c98b1af04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb516d6-9bc2-4837-8aa1-406f966bacb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd75ee559f3b4b66b943d66f09bc0771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:19Z,use_quota=True,user_id='a59c32b1f90f45d4b1de2bc791de65b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ddea85-ec3d-4e1d-9571-1882c1a546b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ddea85-ec3d-4e1d-9571-1882c1a546b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011c6c58-7106-411c-824c-7271dc916401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (011c6c58-7106-411c-824c-7271dc916401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccb516d6-9bc2-4837-8aa1-406f966bacb5', 'volume_name': 'volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103ac1a8-d8e1-4b91-8e9e-b8bba5595f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103ac1a8-d8e1-4b91-8e9e-b8bba5595f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6827e1c-7a65-4f69-997f-87446b2ed5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:19 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Volume ccb516d6-9bc2-4837-8aa1-406f966bacb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5', 'volume_size': 1} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccb516d6-9bc2-4837-8aa1-406f966bacb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd75ee559f3b4b66b943d66f09bc0771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:19Z,use_quota=True,user_id='a59c32b1f90f45d4b1de2bc791de65b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Creating volume ccb516d6-9bc2-4837-8aa1-406f966bacb5 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:19 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:19 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5 1073741824 Jul 24 16:01:19 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Acquiring lock "cinder-b53425db-4ae5-4619-a824-dc18cd6a11ec-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Lock "cinder-b53425db-4ae5-4619-a824-dc18cd6a11ec-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Acquiring lock "cinder-quobyte-b53425db-4ae5-4619-a824-dc18cd6a11ec" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Lock "cinder-quobyte-b53425db-4ae5-4619-a824-dc18cd6a11ec" acquired by "delete_volume" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b4b65c-0c4f-47bb-95af-d3eb4007f543]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Flow 'volume_create_manager' (bda483a9-8f7a-42cf-b736-8e274d09088e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:19 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebaae219-e474-4c2f-b5af-c21cfa05aa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebaae219-e474-4c2f-b5af-c21cfa05aa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-72482260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e656e0b-8377-47a2-b062-ab28ee252171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677136daa4fb46dfa991d9d2744939df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:20Z,use_quota=True,user_id='94779bca900e425bb8d91c3f4053b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292d0dad-f7c8-4aac-9286-3bea3c541a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292d0dad-f7c8-4aac-9286-3bea3c541a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7515da8c-c8b1-40d5-9cd3-65e91077d3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7515da8c-c8b1-40d5-9cd3-65e91077d3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e656e0b-8377-47a2-b062-ab28ee252171', 'volume_name': 'volume-6e656e0b-8377-47a2-b062-ab28ee252171', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02a59fc-b2fe-4c70-9e40-01b2724684b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02a59fc-b2fe-4c70-9e40-01b2724684b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62c5f6a-c9a8-4a34-b09c-48d461f8f401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:20 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume 6e656e0b-8377-47a2-b062-ab28ee252171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e656e0b-8377-47a2-b062-ab28ee252171', 'volume_size': 1} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:20 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec Jul 24 16:01:20 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:20 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5 1073741824" returned: 0 in 0.658s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:20 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5 Jul 24 16:01:20 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:20 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec" returned: 0 in 0.636s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:20 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec Jul 24 16:01:20 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Flow 'volume_create_manager' (0cdb5bba-5a55-42cb-ba52-4f3b53fe83f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b87944-4522-4f66-9178-8b6b9c4f2ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:20 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b87944-4522-4f66-9178-8b6b9c4f2ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-449093801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677136daa4fb46dfa991d9d2744939df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:20Z,use_quota=True,user_id='94779bca900e425bb8d91c3f4053b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b811a73a-3ef4-4ebd-8f14-5a3cf4272f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b811a73a-3ef4-4ebd-8f14-5a3cf4272f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad46784-86e8-4ab6-ac63-cd6422e10cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad46784-86e8-4ab6-ac63-cd6422e10cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40', 'volume_name': 'volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a83ea29-0561-4c50-9701-6686b2ab75a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a83ea29-0561-4c50-9701-6686b2ab75a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ea1a84-e833-460f-90ca-c790b62a47d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:20 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume 2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40', 'volume_size': 1} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5" returned: 0 in 0.371s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-72482260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e656e0b-8377-47a2-b062-ab28ee252171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677136daa4fb46dfa991d9d2744939df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:20Z,use_quota=True,user_id='94779bca900e425bb8d91c3f4053b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Creating volume 6e656e0b-8377-47a2-b062-ab28ee252171 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:20 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6e656e0b-8377-47a2-b062-ab28ee252171 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:20 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6e656e0b-8377-47a2-b062-ab28ee252171 1073741824 Jul 24 16:01:20 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6827e1c-7a65-4f69-997f-87446b2ed5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3defa4fd-60f3-43ec-b191-0e0676d9165f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:20 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Volume volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5 (ccb516d6-9bc2-4837-8aa1-406f966bacb5): created successfully Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3defa4fd-60f3-43ec-b191-0e0676d9165f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Flow 'volume_create_manager' (2b5ca31b-66b7-4440-9323-737943614332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:20 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f0938681-6114-4bca-82b9-f02959d4f54c tempest-CinderUnicodeTest-1783778465 None] Created volume successfully. Jul 24 16:01:20 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b53425db-4ae5-4619-a824-dc18cd6a11ec" returned: 0 in 0.436s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:20 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Lock "cinder-quobyte-b53425db-4ae5-4619-a824-dc18cd6a11ec" released by "delete_volume" :: held 1.151s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Created reservations ['c5ea4ecc-0cff-4189-902e-baf3ed8382a1', 'bc423ec5-a26a-4d81-8d3b-85553addd5a4', '15656b6d-a55a-4b18-ab0f-3e5e284bf379', 'c03abf67-7fd9-4b3a-9daf-ee0f6aa856d4'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Flow 'volume_create_manager' (fe040ff7-bdaf-4bbe-93b7-2b89d0e8e62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd21b7c-ce9e-42ed-a192-9ef2b3ec8a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bd21b7c-ce9e-42ed-a192-9ef2b3ec8a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-326614832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383bff7e-45b1-4abb-a742-00becf2f7d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677136daa4fb46dfa991d9d2744939df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:21Z,use_quota=True,user_id='94779bca900e425bb8d91c3f4053b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4b3924-7e2f-4c96-8598-cdc72ba82565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4b3924-7e2f-4c96-8598-cdc72ba82565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56958be-bb1e-4b18-98ea-f873debdf925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56958be-bb1e-4b18-98ea-f873debdf925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383bff7e-45b1-4abb-a742-00becf2f7d8f', 'volume_name': 'volume-383bff7e-45b1-4abb-a742-00becf2f7d8f', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d44f554-f3e7-40ba-bd7c-a09f90c7e824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d44f554-f3e7-40ba-bd7c-a09f90c7e824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15eca630-0b4a-491d-8c63-492fe461716c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:21 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume 383bff7e-45b1-4abb-a742-00becf2f7d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383bff7e-45b1-4abb-a742-00becf2f7d8f', 'volume_size': 1} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:21 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6e656e0b-8377-47a2-b062-ab28ee252171 1073741824" returned: 0 in 0.621s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:21 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:21 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6e656e0b-8377-47a2-b062-ab28ee252171 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:21 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6e656e0b-8377-47a2-b062-ab28ee252171 Jul 24 16:01:21 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:21 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6e656e0b-8377-47a2-b062-ab28ee252171" returned: 0 in 0.451s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:21 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.151s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-449093801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677136daa4fb46dfa991d9d2744939df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:20Z,use_quota=True,user_id='94779bca900e425bb8d91c3f4053b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Creating volume 2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:21 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:21 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40 1073741824 Jul 24 16:01:21 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Flow 'volume_create_manager' (1b7f8812-1cd4-4981-9200-82565b177533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862668e9-ebd1-4d59-a92c-600353254962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.629s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:21 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Deleted volume successfully. Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62c5f6a-c9a8-4a34-b09c-48d461f8f401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e656e0b-8377-47a2-b062-ab28ee252171', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52aff2f7-7f7f-4b02-b778-6699565ee954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:21 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862668e9-ebd1-4d59-a92c-600353254962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-825504114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78b05d2-eaef-4ab1-b828-c38d3a181547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677136daa4fb46dfa991d9d2744939df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:22Z,use_quota=True,user_id='94779bca900e425bb8d91c3f4053b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab1c479-3a68-48ac-a0fe-62db339ab5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab1c479-3a68-48ac-a0fe-62db339ab5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2808d3c1-8c82-4002-8613-6971bf29f1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2808d3c1-8c82-4002-8613-6971bf29f1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b78b05d2-eaef-4ab1-b828-c38d3a181547', 'volume_name': 'volume-b78b05d2-eaef-4ab1-b828-c38d3a181547', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8467cf1b-074e-4ce1-93d7-1c05fa3cedec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8467cf1b-074e-4ce1-93d7-1c05fa3cedec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5e993e-bbd8-4ad6-8033-ff6e1ad33eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:22 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume b78b05d2-eaef-4ab1-b828-c38d3a181547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b78b05d2-eaef-4ab1-b828-c38d3a181547', 'volume_size': 1} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:22 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume volume-6e656e0b-8377-47a2-b062-ab28ee252171 (6e656e0b-8377-47a2-b062-ab28ee252171): created successfully Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52aff2f7-7f7f-4b02-b778-6699565ee954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Flow 'volume_create_manager' (bda483a9-8f7a-42cf-b736-8e274d09088e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-29ad02f2-2c95-4295-9dc9-5c463442fbcb tempest-VolumeImageDependencyTests-627234742 None] Lock "cinder-b53425db-4ae5-4619-a824-dc18cd6a11ec-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:22 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-db8c0216-24d9-44a2-aa39-50b18f9a7055 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Created volume successfully. Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Flow 'volume_create_manager' (12d082c8-37d5-449c-bb71-6e0d67c6fdd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a298faf-c9ae-48dc-aab0-3795e338b796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:22 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40 1073741824" returned: 0 in 0.902s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a298faf-c9ae-48dc-aab0-3795e338b796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1108250608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea66db81-e410-46c1-a9ea-ff3cffc49534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677136daa4fb46dfa991d9d2744939df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:23Z,use_quota=True,user_id='94779bca900e425bb8d91c3f4053b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a70bbaa-43e2-4d20-a382-28691ad83a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a70bbaa-43e2-4d20-a382-28691ad83a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f57d3d6-3b0d-45e6-b924-55d536d2cdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f57d3d6-3b0d-45e6-b924-55d536d2cdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea66db81-e410-46c1-a9ea-ff3cffc49534', 'volume_name': 'volume-ea66db81-e410-46c1-a9ea-ff3cffc49534', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95323b78-421e-4c32-b517-c2c2db60fda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95323b78-421e-4c32-b517-c2c2db60fda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a53dbd-633b-41a2-a200-833f7e60cdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:22 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume ea66db81-e410-46c1-a9ea-ff3cffc49534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea66db81-e410-46c1-a9ea-ff3cffc49534', 'volume_size': 1} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Flow 'volume_create_manager' (affe07ac-4938-464d-9d7d-85cfb2d1f8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8632aa60-f8ca-4523-b227-d0073fae2417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8632aa60-f8ca-4523-b227-d0073fae2417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2090478932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f97457-4508-458c-a74e-16c217a79696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd75ee559f3b4b66b943d66f09bc0771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:23Z,use_quota=True,user_id='a59c32b1f90f45d4b1de2bc791de65b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0842aa83-3743-4b60-966b-d3cc8e4927df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0842aa83-3743-4b60-966b-d3cc8e4927df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046cfc84-de9a-432e-a9f8-979abaf40cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046cfc84-de9a-432e-a9f8-979abaf40cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73f97457-4508-458c-a74e-16c217a79696', 'volume_name': 'volume-73f97457-4508-458c-a74e-16c217a79696', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62fa1e1-3502-45d3-ab8c-47ac2fcfe57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62fa1e1-3502-45d3-ab8c-47ac2fcfe57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686599b2-b4e2-4419-8434-2636a6f797e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:22 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Volume 73f97457-4508-458c-a74e-16c217a79696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73f97457-4508-458c-a74e-16c217a79696', 'volume_size': 1} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:22 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40 Jul 24 16:01:22 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:23 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40" returned: 0 in 0.276s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.964s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-326614832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383bff7e-45b1-4abb-a742-00becf2f7d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677136daa4fb46dfa991d9d2744939df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:21Z,use_quota=True,user_id='94779bca900e425bb8d91c3f4053b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Creating volume 383bff7e-45b1-4abb-a742-00becf2f7d8f {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:23 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-383bff7e-45b1-4abb-a742-00becf2f7d8f 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50ea1a84-e833-460f-90ca-c790b62a47d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1426752d-fee7-4027-bc0a-e7622560e336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:23 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-383bff7e-45b1-4abb-a742-00becf2f7d8f 1073741824 Jul 24 16:01:23 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:23 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40 (2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40): created successfully Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1426752d-fee7-4027-bc0a-e7622560e336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Flow 'volume_create_manager' (0cdb5bba-5a55-42cb-ba52-4f3b53fe83f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:23 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7f75a503-a785-41ba-ad22-e4328d8b05e5 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Created volume successfully. Jul 24 16:01:23 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-383bff7e-45b1-4abb-a742-00becf2f7d8f 1073741824" returned: 0 in 0.591s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-383bff7e-45b1-4abb-a742-00becf2f7d8f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:23 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-383bff7e-45b1-4abb-a742-00becf2f7d8f Jul 24 16:01:23 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:24 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-383bff7e-45b1-4abb-a742-00becf2f7d8f" returned: 0 in 0.300s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.106s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-825504114',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78b05d2-eaef-4ab1-b828-c38d3a181547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677136daa4fb46dfa991d9d2744939df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:22Z,use_quota=True,user_id='94779bca900e425bb8d91c3f4053b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Creating volume b78b05d2-eaef-4ab1-b828-c38d3a181547 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:24 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b78b05d2-eaef-4ab1-b828-c38d3a181547 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15eca630-0b4a-491d-8c63-492fe461716c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383bff7e-45b1-4abb-a742-00becf2f7d8f', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd1828c-5adf-4870-9a27-fb7f84e5e3ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:24 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b78b05d2-eaef-4ab1-b828-c38d3a181547 1073741824 Jul 24 16:01:24 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:24 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume volume-383bff7e-45b1-4abb-a742-00becf2f7d8f (383bff7e-45b1-4abb-a742-00becf2f7d8f): created successfully Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd1828c-5adf-4870-9a27-fb7f84e5e3ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Flow 'volume_create_manager' (fe040ff7-bdaf-4bbe-93b7-2b89d0e8e62a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:24 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-0f7c8c51-11de-464b-b33d-eb941d5093d2 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Created volume successfully. Jul 24 16:01:24 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b78b05d2-eaef-4ab1-b828-c38d3a181547 1073741824" returned: 0 in 0.549s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b78b05d2-eaef-4ab1-b828-c38d3a181547 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:24 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b78b05d2-eaef-4ab1-b828-c38d3a181547 Jul 24 16:01:24 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:25 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b78b05d2-eaef-4ab1-b828-c38d3a181547" returned: 0 in 0.264s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.204s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1108250608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea66db81-e410-46c1-a9ea-ff3cffc49534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677136daa4fb46dfa991d9d2744939df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:23Z,use_quota=True,user_id='94779bca900e425bb8d91c3f4053b51e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Creating volume ea66db81-e410-46c1-a9ea-ff3cffc49534 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:25 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ea66db81-e410-46c1-a9ea-ff3cffc49534 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5e993e-bbd8-4ad6-8033-ff6e1ad33eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b78b05d2-eaef-4ab1-b828-c38d3a181547', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4990694f-7039-4fa1-8db1-b63f8bdc23d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:25 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ea66db81-e410-46c1-a9ea-ff3cffc49534 1073741824 Jul 24 16:01:25 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:25 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume volume-b78b05d2-eaef-4ab1-b828-c38d3a181547 (b78b05d2-eaef-4ab1-b828-c38d3a181547): created successfully Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4990694f-7039-4fa1-8db1-b63f8bdc23d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Flow 'volume_create_manager' (1b7f8812-1cd4-4981-9200-82565b177533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:25 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-187d5129-5413-45f8-904b-329e26e3cc73 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Created volume successfully. Jul 24 16:01:25 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ea66db81-e410-46c1-a9ea-ff3cffc49534 1073741824" returned: 0 in 0.527s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ea66db81-e410-46c1-a9ea-ff3cffc49534 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:25 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ea66db81-e410-46c1-a9ea-ff3cffc49534 Jul 24 16:01:25 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:25 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ea66db81-e410-46c1-a9ea-ff3cffc49534" returned: 0 in 0.285s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.991s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2090478932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f97457-4508-458c-a74e-16c217a79696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd75ee559f3b4b66b943d66f09bc0771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:23Z,use_quota=True,user_id='a59c32b1f90f45d4b1de2bc791de65b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Creating volume 73f97457-4508-458c-a74e-16c217a79696 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:25 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a53dbd-633b-41a2-a200-833f7e60cdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea66db81-e410-46c1-a9ea-ff3cffc49534', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6492c9-86e8-4425-83c5-c7367ef663e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:25 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696 1073741824 Jul 24 16:01:25 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:25 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Volume volume-ea66db81-e410-46c1-a9ea-ff3cffc49534 (ea66db81-e410-46c1-a9ea-ff3cffc49534): created successfully Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6492c9-86e8-4425-83c5-c7367ef663e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Flow 'volume_create_manager' (12d082c8-37d5-449c-bb71-6e0d67c6fdd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:25 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a245eb5e-365f-40fd-ae3d-5cd8dd274a50 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Created volume successfully. Jul 24 16:01:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3ac50ada-71fd-44ff-9913-e0b45ae0ec3d tempest-ProjectAdminTests-976141673 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577056884766, 'free_capacity_gb': 1775.7577056884766, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88350) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 24 16:01:26 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696 1073741824" returned: 0 in 0.541s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:26 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696 Jul 24 16:01:26 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:26 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696" returned: 0 in 0.338s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:26 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686599b2-b4e2-4419-8434-2636a6f797e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73f97457-4508-458c-a74e-16c217a79696', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82b4fd8-15a6-4ced-9eaf-32dc3caf2129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:26 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Volume volume-73f97457-4508-458c-a74e-16c217a79696 (73f97457-4508-458c-a74e-16c217a79696): created successfully Jul 24 16:01:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82b4fd8-15a6-4ced-9eaf-32dc3caf2129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Flow 'volume_create_manager' (affe07ac-4938-464d-9d7d-85cfb2d1f8c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:26 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-db62f808-3b8c-48bd-91b6-d942fd607e29 tempest-CinderUnicodeTest-1783778465 None] Created volume successfully. Jul 24 16:01:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "cinder-ea66db81-e410-46c1-a9ea-ff3cffc49534-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-ea66db81-e410-46c1-a9ea-ff3cffc49534-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "cinder-quobyte-ea66db81-e410-46c1-a9ea-ff3cffc49534" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-ea66db81-e410-46c1-a9ea-ff3cffc49534" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:27 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c5f495-08ee-4d93-be3a-3a8ced9ce3bf]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ea66db81-e410-46c1-a9ea-ff3cffc49534 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:27 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ea66db81-e410-46c1-a9ea-ff3cffc49534 Jul 24 16:01:27 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:27 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ea66db81-e410-46c1-a9ea-ff3cffc49534" returned: 0 in 0.425s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ea66db81-e410-46c1-a9ea-ff3cffc49534 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:27 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ea66db81-e410-46c1-a9ea-ff3cffc49534 Jul 24 16:01:27 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:27 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ea66db81-e410-46c1-a9ea-ff3cffc49534" returned: 0 in 0.288s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:27 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-ea66db81-e410-46c1-a9ea-ff3cffc49534" released by "delete_volume" :: held 0.763s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:27 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Created reservations ['df1ec25c-bf15-4582-acd9-a0384507d1ba', 'c1688468-1cbf-40d8-8116-834c19d91d42', '8ec7f5eb-3c80-4d15-a4c8-9e0645ae84a9', '787b87ed-b550-4891-959c-5660ca0e8e18'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:28 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:28 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "cinder-b78b05d2-eaef-4ab1-b828-c38d3a181547-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-b78b05d2-eaef-4ab1-b828-c38d3a181547-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] Creating offline snapshot d2b00dac-45a1-4e2b-876f-5776ce4a9e84 of volume 73f97457-4508-458c-a74e-16c217a79696 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "cinder-quobyte-b78b05d2-eaef-4ab1-b828-c38d3a181547" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-b78b05d2-eaef-4ab1-b828-c38d3a181547" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:28 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b773170-90d9-4654-a9ef-774ef34b1881]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.458s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b566fcec-228e-455b-8f7a-2afdc846927d]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b78b05d2-eaef-4ab1-b828-c38d3a181547 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:28 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Deleted volume successfully. Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-52f3f0ba-1139-45f7-9d58-3f80e231b602 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-ea66db81-e410-46c1-a9ea-ff3cffc49534-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:28 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b78b05d2-eaef-4ab1-b828-c38d3a181547 Jul 24 16:01:28 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:28 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696 Jul 24 16:01:28 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:28 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b78b05d2-eaef-4ab1-b828-c38d3a181547" returned: 0 in 0.492s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b78b05d2-eaef-4ab1-b828-c38d3a181547 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:29 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b78b05d2-eaef-4ab1-b828-c38d3a181547 Jul 24 16:01:29 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:29 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696" returned: 0 in 0.634s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:29 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84 1G Jul 24 16:01:29 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:29 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-b78b05d2-eaef-4ab1-b828-c38d3a181547" returned: 0 in 0.363s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-b78b05d2-eaef-4ab1-b828-c38d3a181547" released by "delete_volume" :: held 0.940s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Created reservations ['87400e14-45d1-4138-b543-10cb23e58cb4', '38aef980-acae-4ca3-9526-d4228b4a21a4', 'cec360a2-0684-4b99-b4b4-5daec575445f', '278978eb-891c-4ba3-8ac3-4d60eb9d48b0'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:29 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:29 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:29 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84 1G" returned: 0 in 0.617s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73f97457-4508-458c-a74e-16c217a79696 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:29 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73f97457-4508-458c-a74e-16c217a79696 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84 Jul 24 16:01:29 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:29 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.314s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:29 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Deleted volume successfully. Jul 24 16:01:29 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1c30f127-0c7f-41b5-aff6-a09b54517b36 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-b78b05d2-eaef-4ab1-b828-c38d3a181547-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:30 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73f97457-4508-458c-a74e-16c217a79696 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84" returned: 0 in 0.362s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:30 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84 is being set with open permissions: ugo+rw Jul 24 16:01:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:30 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84 Jul 24 16:01:30 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:30 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84" returned: 0 in 0.321s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:30 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.info Jul 24 16:01:30 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "cinder-383bff7e-45b1-4abb-a742-00becf2f7d8f-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-383bff7e-45b1-4abb-a742-00becf2f7d8f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "cinder-quobyte-383bff7e-45b1-4abb-a742-00becf2f7d8f" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-383bff7e-45b1-4abb-a742-00becf2f7d8f" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:30 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7f66cd-7a4b-4a8e-ba32-df0361ec5a5a]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-383bff7e-45b1-4abb-a742-00becf2f7d8f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:30 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.info" returned: 0 in 0.356s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:30 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.info is being set with open permissions: ugo+rw Jul 24 16:01:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:30 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.info Jul 24 16:01:30 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:30 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-383bff7e-45b1-4abb-a742-00becf2f7d8f Jul 24 16:01:30 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:31 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.info" returned: 0 in 0.329s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.784s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:31 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:31 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d9659a5d-83fb-445b-8af8-0919f2b9c9f1 tempest-CinderUnicodeTest-1783778465 None] Create snapshot completed successfully Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-383bff7e-45b1-4abb-a742-00becf2f7d8f" returned: 0 in 0.467s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-383bff7e-45b1-4abb-a742-00becf2f7d8f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:31 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-383bff7e-45b1-4abb-a742-00becf2f7d8f Jul 24 16:01:31 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:31 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-383bff7e-45b1-4abb-a742-00becf2f7d8f" returned: 0 in 0.340s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Acquiring lock "cinder-d2b00dac-45a1-4e2b-876f-5776ce4a9e84-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-383bff7e-45b1-4abb-a742-00becf2f7d8f" released by "delete_volume" :: held 0.875s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Lock "cinder-d2b00dac-45a1-4e2b-876f-5776ce4a9e84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Acquiring lock "cinder-quobyte-73f97457-4508-458c-a74e-16c217a79696" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Lock "cinder-quobyte-73f97457-4508-458c-a74e-16c217a79696" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Acquiring lock "cinder-quobyte-d2b00dac-45a1-4e2b-876f-5776ce4a9e84" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Lock "cinder-quobyte-d2b00dac-45a1-4e2b-876f-5776ce4a9e84" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Deleting offline snapshot d2b00dac-45a1-4e2b-876f-5776ce4a9e84 of volume 73f97457-4508-458c-a74e-16c217a79696 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] snapshot_file for this snap is: volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cdb003-18a8-4e9d-9242-410bf73c5c74]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Created reservations ['953af612-251e-4281-9db1-37f4ef6619af', '1f4c235e-271a-4130-9773-5c8cea6e1139', 'b5872eb5-3496-41d0-b823-c29adeb81981', '0baf99cd-76e8-41b6-a6fc-61a7b9bb0aa5'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:31 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:31 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:31 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84 Jul 24 16:01:31 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:32 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.271s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:32 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:32 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Deleted volume successfully. Jul 24 16:01:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3093b997-23d1-4748-b56f-d33aec19767e tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-383bff7e-45b1-4abb-a742-00becf2f7d8f-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:32 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84" returned: 0 in 0.449s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73f97457-4508-458c-a74e-16c217a79696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:01:32 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dde3ce-1d3e-443e-9b5a-1fcdfd16a98a]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:32 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696 Jul 24 16:01:32 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:32 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696" returned: 0 in 0.436s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:32 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84 Jul 24 16:01:32 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "cinder-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:33 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84" returned: 0 in 0.441s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:33 devstack sudo[108297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84 Jul 24 16:01:33 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "cinder-quobyte-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40" acquired by "delete_volume" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[015170db-98cb-4d91-b5d6-650e6afee620]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:33 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40 Jul 24 16:01:33 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:33 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696.d2b00dac-45a1-4e2b-876f-5776ce4a9e84" returned: 0 in 0.341s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Lock "cinder-quobyte-d2b00dac-45a1-4e2b-876f-5776ce4a9e84" released by "_delete_snapshot" :: held 1.826s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Lock "cinder-quobyte-73f97457-4508-458c-a74e-16c217a79696" released by "delete_snapshot" :: held 1.875s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Created reservations ['276abe6e-cd41-4758-83fe-2b2900c4cc7d', 'e7d0a031-1ed1-4763-9131-3eab54edcf0e', '484ad9e2-9920-4b7b-ad73-04fedec6d71c', '67660144-8fed-486d-bc30-f4d89c7a9cc5'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:33 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40" returned: 0 in 0.504s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:33 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40 Jul 24 16:01:33 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:33 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Delete snapshot completed successfully. Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a80847fe-8df8-44d3-b4ee-653bb3b63666 tempest-CinderUnicodeTest-1783778465 None] Lock "cinder-d2b00dac-45a1-4e2b-876f-5776ce4a9e84-delete_snapshot" released by "delete_snapshot" :: held 2.160s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Acquiring lock "cinder-73f97457-4508-458c-a74e-16c217a79696-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Lock "cinder-73f97457-4508-458c-a74e-16c217a79696-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Acquiring lock "cinder-quobyte-73f97457-4508-458c-a74e-16c217a79696" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Lock "cinder-quobyte-73f97457-4508-458c-a74e-16c217a79696" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd302168-7401-46cf-bc18-e69a096d8ebc]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:34 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40" returned: 0 in 0.378s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40" released by "delete_volume" :: held 0.936s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:34 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696 Jul 24 16:01:34 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Created reservations ['ae140504-1bc2-41a6-8527-0f2afde4f3aa', 'bf262869-35d4-4493-820c-123b171d1f26', '8fc818f3-d7ba-4290-bbcf-2e6b91193a10', '1acbd472-04fc-498c-8a34-891e757e8c80'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:34 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:34 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "cinder-6e656e0b-8377-47a2-b062-ab28ee252171-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-6e656e0b-8377-47a2-b062-ab28ee252171-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "cinder-quobyte-6e656e0b-8377-47a2-b062-ab28ee252171" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-6e656e0b-8377-47a2-b062-ab28ee252171" acquired by "delete_volume" :: waited 0.032s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[502f447b-dacb-49f6-aa4b-0e9c87abab63]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6e656e0b-8377-47a2-b062-ab28ee252171 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:34 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696" returned: 0 in 0.500s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:34 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696 Jul 24 16:01:34 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:34 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6e656e0b-8377-47a2-b062-ab28ee252171 Jul 24 16:01:34 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:34 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.379s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:34 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Deleted volume successfully. Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-623edd97-dbb4-4429-9991-ecd9d0e1d621 tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-2211fdf0-fed0-4860-9fb7-fa5b4b5f0e40-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:34 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-73f97457-4508-458c-a74e-16c217a79696" returned: 0 in 0.327s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Lock "cinder-quobyte-73f97457-4508-458c-a74e-16c217a79696" released by "delete_volume" :: held 0.901s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Created reservations ['a14f44a9-c23a-4531-a975-0be0f8313f0f', '6a0cca5a-e338-4614-961b-b1a47a87fb1a', '2003e317-16fc-4bab-9b06-cd1770cee049', '5a4cf9e7-7c13-4850-a119-8adbf8a386aa'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:34 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6e656e0b-8377-47a2-b062-ab28ee252171" returned: 0 in 0.523s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6e656e0b-8377-47a2-b062-ab28ee252171 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:35 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6e656e0b-8377-47a2-b062-ab28ee252171 Jul 24 16:01:35 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:35 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:35 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:35 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6e656e0b-8377-47a2-b062-ab28ee252171" returned: 0 in 0.351s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-6e656e0b-8377-47a2-b062-ab28ee252171" released by "delete_volume" :: held 0.934s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:35 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.394s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:35 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Deleted volume successfully. Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Created reservations ['59e3eb4d-0643-4a1b-9020-7e8336986ceb', 'f7a614d0-43ff-4f5f-81f4-7e9ea6390133', '601d4171-028d-4ea3-919f-eddc0a2c1b01', '357c6af7-6a70-405a-bb2b-d0aeeee10569'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-250fa050-f367-411c-8b55-36182c914fb7 tempest-CinderUnicodeTest-1783778465 None] Lock "cinder-73f97457-4508-458c-a74e-16c217a79696-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:35 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:35 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:35 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.286s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:35 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Deleted volume successfully. Jul 24 16:01:35 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-dfe9dae8-5eb8-4929-bd00-1212d584d31b tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-6e656e0b-8377-47a2-b062-ab28ee252171-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Acquiring lock "cinder-ccb516d6-9bc2-4837-8aa1-406f966bacb5-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Lock "cinder-ccb516d6-9bc2-4837-8aa1-406f966bacb5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Acquiring lock "cinder-quobyte-ccb516d6-9bc2-4837-8aa1-406f966bacb5" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Lock "cinder-quobyte-ccb516d6-9bc2-4837-8aa1-406f966bacb5" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[10aceeee-9cbf-4c00-80fd-a2f124e6eb65]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:36 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5 Jul 24 16:01:36 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "cinder-b34e8514-b309-42cf-a6ac-4b14fcb6be3d-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-b34e8514-b309-42cf-a6ac-4b14fcb6be3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "cinder-quobyte-7c21b05e-5295-4e58-a428-34a2d134ead5" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-7c21b05e-5295-4e58-a428-34a2d134ead5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "cinder-quobyte-b34e8514-b309-42cf-a6ac-4b14fcb6be3d" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-b34e8514-b309-42cf-a6ac-4b14fcb6be3d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:36 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Deleting offline snapshot b34e8514-b309-42cf-a6ac-4b14fcb6be3d of volume 7c21b05e-5295-4e58-a428-34a2d134ead5 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] snapshot_file for this snap is: volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5" returned: 0 in 0.542s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffacedac-030e-4eb0-824f-fbd1da75ec56]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:36 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5 Jul 24 16:01:36 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:36 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d Jul 24 16:01:36 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:37 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ccb516d6-9bc2-4837-8aa1-406f966bacb5" returned: 0 in 0.391s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Lock "cinder-quobyte-ccb516d6-9bc2-4837-8aa1-406f966bacb5" released by "delete_volume" :: held 0.986s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Created reservations ['959191d4-55ba-468f-af65-c031ffaecc9f', 'c3e69b76-1c00-4884-8710-630aa6910a77', 'baa78f41-8dfb-4a4f-90a9-3535a2656e79', '0102e18a-3111-4ea1-a873-b4dbd1ae7022'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:37 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d" returned: 0 in 0.536s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c21b05e-5295-4e58-a428-34a2d134ead5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d346f7-47db-4903-8453-219fca047a77]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:37 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:37 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:37 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5 Jul 24 16:01:37 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:37 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.348s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:37 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Deleted volume successfully. Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-49985abb-0367-41f8-bb95-b9d786f5a1ae tempest-CinderUnicodeTest-1783778465 None] Lock "cinder-ccb516d6-9bc2-4837-8aa1-406f966bacb5-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:37 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5" returned: 0 in 0.486s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:37 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d Jul 24 16:01:37 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:38 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d" returned: 0 in 0.407s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:38 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d Jul 24 16:01:38 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:38 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5.b34e8514-b309-42cf-a6ac-4b14fcb6be3d" returned: 0 in 0.444s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:38 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-b34e8514-b309-42cf-a6ac-4b14fcb6be3d" released by "_delete_snapshot" :: held 2.059s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:38 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-7c21b05e-5295-4e58-a428-34a2d134ead5" released by "delete_snapshot" :: held 2.100s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:38 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Created reservations ['cc8c8abc-839a-4187-922f-4e51425ed568', 'ae1e4c90-3edc-45fb-bbda-a29233b1a456', '48fa9ad0-2516-45a7-9795-fcf66086dbad', '470563fd-cd14-4ee9-b455-378c36c129e5'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:39 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Delete snapshot completed successfully. Jul 24 16:01:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0db34c4f-75d4-40ab-aa29-5f738c71d4bb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-b34e8514-b309-42cf-a6ac-4b14fcb6be3d-delete_snapshot" released by "delete_snapshot" :: held 2.309s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "cinder-7c21b05e-5295-4e58-a428-34a2d134ead5-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 16:01:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-7c21b05e-5295-4e58-a428-34a2d134ead5-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:40 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:40 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "cinder-quobyte-7c21b05e-5295-4e58-a428-34a2d134ead5" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-7c21b05e-5295-4e58-a428-34a2d134ead5" acquired by "delete_volume" :: waited 0.027s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e62bdc-84bc-4029-9b4f-75017895365c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:40 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5 Jul 24 16:01:40 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:40 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.412s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Flow 'volume_create_manager' (2933b62e-e91b-4bcd-8548-41d361c8658b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83af8d5d-0adf-4b97-b063-5ad592d8c815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83af8d5d-0adf-4b97-b063-5ad592d8c815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1125494925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54421c79-36ab-44c2-b22b-f6c2812fa14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33471a16298a4c76895af2c6ddb7628a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:40Z,use_quota=True,user_id='511e6713b7e444a3b6b2f0b6aa0b5331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f6f28e-0926-4c6c-ad20-1f2c38eb5fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f6f28e-0926-4c6c-ad20-1f2c38eb5fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58983f2d-3c03-4791-affc-4a4a430a04c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:40 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58983f2d-3c03-4791-affc-4a4a430a04c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54421c79-36ab-44c2-b22b-f6c2812fa14b', 'volume_name': 'volume-54421c79-36ab-44c2-b22b-f6c2812fa14b', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badc6329-6ad2-42ae-b5c4-367f30b636e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badc6329-6ad2-42ae-b5c4-367f30b636e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f44e9a-0179-401a-b42a-99fc6966b5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:40 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Volume 54421c79-36ab-44c2-b22b-f6c2812fa14b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54421c79-36ab-44c2-b22b-f6c2812fa14b', 'volume_size': 1} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1125494925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54421c79-36ab-44c2-b22b-f6c2812fa14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33471a16298a4c76895af2c6ddb7628a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:40Z,use_quota=True,user_id='511e6713b7e444a3b6b2f0b6aa0b5331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Creating volume 54421c79-36ab-44c2-b22b-f6c2812fa14b {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:40 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-54421c79-36ab-44c2-b22b-f6c2812fa14b 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5" returned: 0 in 0.483s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:40 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-54421c79-36ab-44c2-b22b-f6c2812fa14b 1073741824 Jul 24 16:01:40 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:40 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5 Jul 24 16:01:40 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:40 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7c21b05e-5295-4e58-a428-34a2d134ead5" returned: 0 in 0.314s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-quobyte-7c21b05e-5295-4e58-a428-34a2d134ead5" released by "delete_volume" :: held 0.883s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Created reservations ['b6f9aa55-7ee8-49b5-9119-d73a27d5129b', '9253819c-54ca-4f46-8418-bec8e1e304e8', '9c67a26e-99eb-45cd-a7f8-624700781858', '912ddbab-0ed7-4488-aa16-1f5086a43190'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:41 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:41 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:41 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-54421c79-36ab-44c2-b22b-f6c2812fa14b 1073741824" returned: 0 in 0.617s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-54421c79-36ab-44c2-b22b-f6c2812fa14b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:41 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-54421c79-36ab-44c2-b22b-f6c2812fa14b Jul 24 16:01:41 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:41 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.372s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:41 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Deleted volume successfully. Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-aec847c6-c4b0-4468-9828-30764c6fb3eb tempest-CreateVolumesFromSnapshotTest-2086101417 None] Lock "cinder-7c21b05e-5295-4e58-a428-34a2d134ead5-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:41 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-54421c79-36ab-44c2-b22b-f6c2812fa14b" returned: 0 in 0.410s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65f44e9a-0179-401a-b42a-99fc6966b5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54421c79-36ab-44c2-b22b-f6c2812fa14b', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed1df75-4818-4904-bdf9-027fbfb7af47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:41 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Volume volume-54421c79-36ab-44c2-b22b-f6c2812fa14b (54421c79-36ab-44c2-b22b-f6c2812fa14b): created successfully Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed1df75-4818-4904-bdf9-027fbfb7af47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Flow 'volume_create_manager' (2933b62e-e91b-4bcd-8548-41d361c8658b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:41 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-31380058-7d87-4401-a05b-d7e7e5b11f37 tempest-ProjectReaderTests-1541451379 None] Created volume successfully. Jul 24 16:01:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Acquiring lock "cinder-54421c79-36ab-44c2-b22b-f6c2812fa14b-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Lock "cinder-54421c79-36ab-44c2-b22b-f6c2812fa14b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Acquiring lock "cinder-quobyte-54421c79-36ab-44c2-b22b-f6c2812fa14b" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Lock "cinder-quobyte-54421c79-36ab-44c2-b22b-f6c2812fa14b" acquired by "delete_volume" :: waited 0.031s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:43 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac175e1d-3716-4af3-8d0b-9a555cf30336]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-54421c79-36ab-44c2-b22b-f6c2812fa14b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:43 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-54421c79-36ab-44c2-b22b-f6c2812fa14b Jul 24 16:01:43 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:43 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-54421c79-36ab-44c2-b22b-f6c2812fa14b" returned: 0 in 0.506s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-54421c79-36ab-44c2-b22b-f6c2812fa14b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:43 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-54421c79-36ab-44c2-b22b-f6c2812fa14b Jul 24 16:01:43 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:44 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-54421c79-36ab-44c2-b22b-f6c2812fa14b" returned: 0 in 0.357s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Lock "cinder-quobyte-54421c79-36ab-44c2-b22b-f6c2812fa14b" released by "delete_volume" :: held 0.924s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:44 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Created reservations ['3bbdd3b4-8194-45a8-8012-e8ebcfabf5f7', '74db9cf8-d2d9-4b8a-832e-250e1665e1b7', '665a0af9-cc9b-40d8-8cc0-35923b33ffe8', 'fa36dcb2-84e8-4ecf-a746-ad1921f361d3'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:44 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:44 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:44 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.289s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:44 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:44 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Deleted volume successfully. Jul 24 16:01:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-4e8fcdfc-ae16-4da9-95d1-fcf03289f6da tempest-ProjectReaderTests-1541451379 None] Lock "cinder-54421c79-36ab-44c2-b22b-f6c2812fa14b-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Flow 'volume_create_manager' (6e758d62-8641-4b4d-bdea-eaff66517cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560e4f38-9536-4092-b63e-84e2d60e97e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560e4f38-9536-4092-b63e-84e2d60e97e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1984644480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d975b9-2fe5-48f2-a354-0b52f0a1b36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33471a16298a4c76895af2c6ddb7628a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:46Z,use_quota=True,user_id='511e6713b7e444a3b6b2f0b6aa0b5331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e23be07-f6ec-47c4-bb60-bc9966cbf6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e23be07-f6ec-47c4-bb60-bc9966cbf6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6c2cc0-e307-41f2-b269-0b8f96912b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6c2cc0-e307-41f2-b269-0b8f96912b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72d975b9-2fe5-48f2-a354-0b52f0a1b36c', 'volume_name': 'volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2dadc0-1826-4968-bc0c-e01ce2b56eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e2dadc0-1826-4968-bc0c-e01ce2b56eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6980a228-f5ac-4015-95c3-fa7fef8d1b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:46 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Volume 72d975b9-2fe5-48f2-a354-0b52f0a1b36c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c', 'volume_size': 1} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1984644480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d975b9-2fe5-48f2-a354-0b52f0a1b36c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33471a16298a4c76895af2c6ddb7628a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:46Z,use_quota=True,user_id='511e6713b7e444a3b6b2f0b6aa0b5331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Creating volume 72d975b9-2fe5-48f2-a354-0b52f0a1b36c {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:46 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:46 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c 1073741824 Jul 24 16:01:46 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=172,cinder:UPDATE=240,cinder:DELETE=20,cinder:INSERT=70 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Flow 'volume_create_manager' (ffbbd3e0-e465-45cc-852a-e53c0d12dbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c340c81-81d7-4bd6-99a1-2ea32dd0e3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c340c81-81d7-4bd6-99a1-2ea32dd0e3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2141637648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ad4025-9076-44e0-8c45-d12fd237e072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a87f505dc8d4580947e029b87e54c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:46Z,use_quota=True,user_id='abaf36e09da74fe788f962b158be26b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2daa36-2fba-41c8-919f-df3c33963639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2daa36-2fba-41c8-919f-df3c33963639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27ff3cd-3365-43c1-a186-571006d5e9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27ff3cd-3365-43c1-a186-571006d5e9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95ad4025-9076-44e0-8c45-d12fd237e072', 'volume_name': 'volume-95ad4025-9076-44e0-8c45-d12fd237e072', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10fa6b19-81ab-4034-94ca-5125987520da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10fa6b19-81ab-4034-94ca-5125987520da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7c87a0-e533-427b-ac8d-bef1ab19abba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:46 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume 95ad4025-9076-44e0-8c45-d12fd237e072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95ad4025-9076-44e0-8c45-d12fd237e072', 'volume_size': 1} Jul 24 16:01:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:47 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c 1073741824" returned: 0 in 0.735s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=192,cinder:UPDATE=249,cinder:INSERT=63,cinder:DELETE=23 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:47 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c Jul 24 16:01:47 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:47 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c" returned: 0 in 0.305s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.867s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2141637648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ad4025-9076-44e0-8c45-d12fd237e072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a87f505dc8d4580947e029b87e54c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:46Z,use_quota=True,user_id='abaf36e09da74fe788f962b158be26b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Creating volume 95ad4025-9076-44e0-8c45-d12fd237e072 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:47 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-95ad4025-9076-44e0-8c45-d12fd237e072 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6980a228-f5ac-4015-95c3-fa7fef8d1b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2779548f-10da-4066-97d5-e4d18b2ef60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:47 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-95ad4025-9076-44e0-8c45-d12fd237e072 1073741824 Jul 24 16:01:47 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:47 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Volume volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c (72d975b9-2fe5-48f2-a354-0b52f0a1b36c): created successfully Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2779548f-10da-4066-97d5-e4d18b2ef60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Flow 'volume_create_manager' (6e758d62-8641-4b4d-bdea-eaff66517cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:47 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-85a2f238-96a1-479f-a7f6-5b97031ffede tempest-ProjectReaderTests-1541451379 None] Created volume successfully. Jul 24 16:01:48 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-95ad4025-9076-44e0-8c45-d12fd237e072 1073741824" returned: 0 in 0.588s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-95ad4025-9076-44e0-8c45-d12fd237e072 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:48 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-95ad4025-9076-44e0-8c45-d12fd237e072 Jul 24 16:01:48 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:48 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Acquiring lock "cinder-72d975b9-2fe5-48f2-a354-0b52f0a1b36c-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:48 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Lock "cinder-72d975b9-2fe5-48f2-a354-0b52f0a1b36c-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:48 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-95ad4025-9076-44e0-8c45-d12fd237e072" returned: 0 in 0.334s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc7c87a0-e533-427b-ac8d-bef1ab19abba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95ad4025-9076-44e0-8c45-d12fd237e072', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60f68f8-434b-40c9-8b8f-0a402f9b7b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:48 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume volume-95ad4025-9076-44e0-8c45-d12fd237e072 (95ad4025-9076-44e0-8c45-d12fd237e072): created successfully Jul 24 16:01:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60f68f8-434b-40c9-8b8f-0a402f9b7b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Flow 'volume_create_manager' (ffbbd3e0-e465-45cc-852a-e53c0d12dbd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:48 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Acquiring lock "cinder-quobyte-72d975b9-2fe5-48f2-a354-0b52f0a1b36c" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:48 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Lock "cinder-quobyte-72d975b9-2fe5-48f2-a354-0b52f0a1b36c" acquired by "delete_volume" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:48 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-896bfff8-dd6d-4ca5-bc77-86905794ceab tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Created volume successfully. Jul 24 16:01:48 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cb55c4-39d5-4f54-98cd-0e30a261bce4]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:48 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c Jul 24 16:01:48 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:49 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c" returned: 0 in 0.423s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:49 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c Jul 24 16:01:49 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:49 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-72d975b9-2fe5-48f2-a354-0b52f0a1b36c" returned: 0 in 0.277s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:49 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Lock "cinder-quobyte-72d975b9-2fe5-48f2-a354-0b52f0a1b36c" released by "delete_volume" :: held 0.760s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:49 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Created reservations ['a03bf753-7b1d-4277-8ddd-afc3bca0fb7b', '2dcad36f-c77d-4b59-b633-09628843a4d8', 'db312bc4-06e2-49d2-a081-6a1be5ae0081', '8644173e-c2ce-4886-b196-9566ee707647'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:49 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:49 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:49 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.308s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:49 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:49 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Deleted volume successfully. Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-0ac2c399-f9c1-4345-a3ed-6e9d02460016 tempest-ProjectReaderTests-1541451379 None] Lock "cinder-72d975b9-2fe5-48f2-a354-0b52f0a1b36c-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Flow 'volume_create_manager' (f001b110-42fc-4b66-b7f1-3a0c5c89af1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f59e2dd-77ea-4415-9af4-66e71f2de923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f59e2dd-77ea-4415-9af4-66e71f2de923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-25411270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4233da90-2ed0-4a2b-acd7-e3fefe0a2c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33471a16298a4c76895af2c6ddb7628a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:50Z,use_quota=True,user_id='511e6713b7e444a3b6b2f0b6aa0b5331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8635bc6-edd1-4e38-94a3-7911e834dc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8635bc6-edd1-4e38-94a3-7911e834dc19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb5fa70-a2f0-44b8-82b4-fb61dfb5b9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb5fa70-a2f0-44b8-82b4-fb61dfb5b9a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4233da90-2ed0-4a2b-acd7-e3fefe0a2c43', 'volume_name': 'volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b020840e-fc7e-4e3a-8d94-c9e8f0a013ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b020840e-fc7e-4e3a-8d94-c9e8f0a013ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3855ba-c711-4767-b5ef-f91c314b8e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:50 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Volume 4233da90-2ed0-4a2b-acd7-e3fefe0a2c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43', 'volume_size': 1} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-25411270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4233da90-2ed0-4a2b-acd7-e3fefe0a2c43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33471a16298a4c76895af2c6ddb7628a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:50Z,use_quota=True,user_id='511e6713b7e444a3b6b2f0b6aa0b5331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Creating volume 4233da90-2ed0-4a2b-acd7-e3fefe0a2c43 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:50 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:50 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43 1073741824 Jul 24 16:01:50 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Flow 'volume_create_manager' (d41e1ac6-3525-4083-a387-222f95468162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6b5c53-fdd7-4a90-8ac3-de1bc703635d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6b5c53-fdd7-4a90-8ac3-de1bc703635d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1574178117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59a51e6-b484-41c1-bb47-5980a7632e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a87f505dc8d4580947e029b87e54c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:51Z,use_quota=True,user_id='abaf36e09da74fe788f962b158be26b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61e4134-71f6-43a9-a4eb-d85c42bd65c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d61e4134-71f6-43a9-a4eb-d85c42bd65c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b289ab53-6124-41b5-8048-35cf1d39dc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b289ab53-6124-41b5-8048-35cf1d39dc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e59a51e6-b484-41c1-bb47-5980a7632e97', 'volume_name': 'volume-e59a51e6-b484-41c1-bb47-5980a7632e97', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f55957-527c-424e-b95f-d35772fca6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5f55957-527c-424e-b95f-d35772fca6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:50 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b01ea7-2fa4-4099-91c6-5f86d48208a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:50 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume e59a51e6-b484-41c1-bb47-5980a7632e97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e59a51e6-b484-41c1-bb47-5980a7632e97', 'volume_size': 1} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Flow 'volume_create_manager' (32ddcd90-abc0-4577-b5c6-d18366108a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c748cded-a5b9-4f01-bfbc-f7b9f0ce16b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c748cded-a5b9-4f01-bfbc-f7b9f0ce16b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-385401310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b98d204-5c98-4ab2-8be2-929e8e1da46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a87f505dc8d4580947e029b87e54c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:51Z,use_quota=True,user_id='abaf36e09da74fe788f962b158be26b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b9dbeb-a3c6-4d81-a431-b996185474eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b9dbeb-a3c6-4d81-a431-b996185474eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bdd7222-c754-40ce-a822-8f3719956d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bdd7222-c754-40ce-a822-8f3719956d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b98d204-5c98-4ab2-8be2-929e8e1da46a', 'volume_name': 'volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644b070d-1343-4abf-a37b-ad86fae70d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644b070d-1343-4abf-a37b-ad86fae70d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b396b46c-e8ab-4c15-951a-f8d5f1940c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:51 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume 6b98d204-5c98-4ab2-8be2-929e8e1da46a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a', 'volume_size': 1} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:51 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43 1073741824" returned: 0 in 0.736s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:51 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43 Jul 24 16:01:51 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Flow 'volume_create_manager' (75456a97-ea69-40c9-908d-a33c779952f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e347c7c-8d01-47f0-b742-77cc83a094fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e347c7c-8d01-47f0-b742-77cc83a094fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-687276939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3406f8f-1a6c-47b5-9575-4399e66f4763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a87f505dc8d4580947e029b87e54c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:51Z,use_quota=True,user_id='abaf36e09da74fe788f962b158be26b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f39952-90ca-4673-9580-e8ce3e6e2aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f39952-90ca-4673-9580-e8ce3e6e2aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299177fc-257c-45b4-a8b2-11270e974a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (299177fc-257c-45b4-a8b2-11270e974a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3406f8f-1a6c-47b5-9575-4399e66f4763', 'volume_name': 'volume-c3406f8f-1a6c-47b5-9575-4399e66f4763', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b70931-fff5-467a-b46c-821603c9f82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b70931-fff5-467a-b46c-821603c9f82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0b1c35-9362-46e4-9f68-3a97aa4f4d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:51 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume c3406f8f-1a6c-47b5-9575-4399e66f4763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3406f8f-1a6c-47b5-9575-4399e66f4763', 'volume_size': 1} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:51 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43" returned: 0 in 0.443s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.953s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1574178117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59a51e6-b484-41c1-bb47-5980a7632e97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a87f505dc8d4580947e029b87e54c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:51Z,use_quota=True,user_id='abaf36e09da74fe788f962b158be26b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Creating volume e59a51e6-b484-41c1-bb47-5980a7632e97 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:51 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e59a51e6-b484-41c1-bb47-5980a7632e97 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3855ba-c711-4767-b5ef-f91c314b8e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:52 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e59a51e6-b484-41c1-bb47-5980a7632e97 1073741824 Jul 24 16:01:52 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d2bdef-ca55-4f9c-ad5b-1d6fe4fbe2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:52 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Volume volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43 (4233da90-2ed0-4a2b-acd7-e3fefe0a2c43): created successfully Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d2bdef-ca55-4f9c-ad5b-1d6fe4fbe2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Flow 'volume_create_manager' (f001b110-42fc-4b66-b7f1-3a0c5c89af1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:52 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-4b3b5998-bea5-4b20-9dd5-cd6b89a3edc8 tempest-ProjectReaderTests-1541451379 None] Created volume successfully. Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Acquiring lock "cinder-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Lock "cinder-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:52 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Flow 'volume_create_manager' (65bed296-2eb6-4499-9778-f3de03b95ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15527d0-7cfe-48ac-ac61-a055ad1970d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e59a51e6-b484-41c1-bb47-5980a7632e97 1073741824" returned: 0 in 0.792s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15527d0-7cfe-48ac-ac61-a055ad1970d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520623513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48da34d8-8cbc-4659-a584-404afafb7b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a87f505dc8d4580947e029b87e54c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:53Z,use_quota=True,user_id='abaf36e09da74fe788f962b158be26b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4be197-c2b9-4acc-8a2a-f9edd3f2ebb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4be197-c2b9-4acc-8a2a-f9edd3f2ebb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a612454d-b876-4d32-8aae-8954ba7fbb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a612454d-b876-4d32-8aae-8954ba7fbb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48da34d8-8cbc-4659-a584-404afafb7b0c', 'volume_name': 'volume-48da34d8-8cbc-4659-a584-404afafb7b0c', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2e2b37-f8d6-45da-a06f-5ae11f94503e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2e2b37-f8d6-45da-a06f-5ae11f94503e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f423d9aa-f33c-4fc3-acef-deca4aee0bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:52 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume 48da34d8-8cbc-4659-a584-404afafb7b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48da34d8-8cbc-4659-a584-404afafb7b0c', 'volume_size': 1} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Acquiring lock "cinder-quobyte-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Lock "cinder-quobyte-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43" acquired by "delete_volume" :: waited 0.047s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e59a51e6-b484-41c1-bb47-5980a7632e97 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[228850cf-b372-45f7-84e4-5d440b5ecf39]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:52 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e59a51e6-b484-41c1-bb47-5980a7632e97 Jul 24 16:01:52 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:53 devstack sudo[108447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43 Jul 24 16:01:53 devstack sudo[108447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Flow 'volume_create_manager' (9512c32f-2218-4b69-b7b9-f6c74b6e2866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0975b9-d043-46d7-88a7-d9889dd2a884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0975b9-d043-46d7-88a7-d9889dd2a884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-577800755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4782524c-75f4-41f0-a655-7f10fd07e4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a87f505dc8d4580947e029b87e54c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:53Z,use_quota=True,user_id='abaf36e09da74fe788f962b158be26b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db59a861-ec64-475a-85be-e31f864de747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db59a861-ec64-475a-85be-e31f864de747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648c579c-ab3f-4f81-96b9-8c291c73d8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648c579c-ab3f-4f81-96b9-8c291c73d8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4782524c-75f4-41f0-a655-7f10fd07e4e5', 'volume_name': 'volume-4782524c-75f4-41f0-a655-7f10fd07e4e5', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55113807-b6de-4679-a772-ec8ea95ba472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55113807-b6de-4679-a772-ec8ea95ba472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f823b864-22b5-4bf2-b906-06b87a7766d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:53 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume 4782524c-75f4-41f0-a655-7f10fd07e4e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4782524c-75f4-41f0-a655-7f10fd07e4e5', 'volume_size': 1} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:53 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e59a51e6-b484-41c1-bb47-5980a7632e97" returned: 0 in 0.335s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.100s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-385401310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b98d204-5c98-4ab2-8be2-929e8e1da46a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a87f505dc8d4580947e029b87e54c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:51Z,use_quota=True,user_id='abaf36e09da74fe788f962b158be26b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Creating volume 6b98d204-5c98-4ab2-8be2-929e8e1da46a {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:53 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:53 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a 1073741824 Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93b01ea7-2fa4-4099-91c6-5f86d48208a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e59a51e6-b484-41c1-bb47-5980a7632e97', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:53 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b49742e-9f91-4294-8228-69e468348afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:53 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume volume-e59a51e6-b484-41c1-bb47-5980a7632e97 (e59a51e6-b484-41c1-bb47-5980a7632e97): created successfully Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b49742e-9f91-4294-8228-69e468348afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Flow 'volume_create_manager' (d41e1ac6-3525-4083-a387-222f95468162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:53 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-cbcae4d9-4139-41e9-8524-0ed5a1703886 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Created volume successfully. Jul 24 16:01:53 devstack sudo[108447]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43" returned: 0 in 0.471s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:53 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43 Jul 24 16:01:53 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:53 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43" returned: 0 in 0.333s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Lock "cinder-quobyte-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43" released by "delete_volume" :: held 0.892s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:53 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Created reservations ['98a89b3e-b9d1-411a-a29c-4013ba34339b', '861b81b7-5f26-45cc-b9b6-f598ba62f284', '81c434c8-584c-46e9-a3f9-b0239e3a732c', '2440af3d-f60d-4673-ba89-171d0f5532b9'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a 1073741824" returned: 0 in 0.648s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:53 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a Jul 24 16:01:53 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:54 devstack sudo[108466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:54 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:54 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a" returned: 0 in 0.355s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.565s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-687276939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3406f8f-1a6c-47b5-9575-4399e66f4763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a87f505dc8d4580947e029b87e54c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:51Z,use_quota=True,user_id='abaf36e09da74fe788f962b158be26b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Creating volume c3406f8f-1a6c-47b5-9575-4399e66f4763 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:54 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c3406f8f-1a6c-47b5-9575-4399e66f4763 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:54 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.355s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:54 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Deleted volume successfully. Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b396b46c-e8ab-4c15-951a-f8d5f1940c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e0083d-404f-441f-b198-2ad1684b3f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:54 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c3406f8f-1a6c-47b5-9575-4399e66f4763 1073741824 Jul 24 16:01:54 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:54 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a (6b98d204-5c98-4ab2-8be2-929e8e1da46a): created successfully Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8e0083d-404f-441f-b198-2ad1684b3f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Flow 'volume_create_manager' (32ddcd90-abc0-4577-b5c6-d18366108a39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6bd8bee3-bdb1-4647-8f6d-0eb14e9e17ad tempest-ProjectReaderTests-1541451379 None] Lock "cinder-4233da90-2ed0-4a2b-acd7-e3fefe0a2c43-delete_volume" released by "delete_volume" :: held 1.788s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:54 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d70a4629-844e-4eaf-809c-492581d6316e tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Created volume successfully. Jul 24 16:01:54 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c3406f8f-1a6c-47b5-9575-4399e66f4763 1073741824" returned: 0 in 0.625s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c3406f8f-1a6c-47b5-9575-4399e66f4763 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:55 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c3406f8f-1a6c-47b5-9575-4399e66f4763 Jul 24 16:01:55 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:55 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c3406f8f-1a6c-47b5-9575-4399e66f4763" returned: 0 in 0.333s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.537s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1520623513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48da34d8-8cbc-4659-a584-404afafb7b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a87f505dc8d4580947e029b87e54c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:53Z,use_quota=True,user_id='abaf36e09da74fe788f962b158be26b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Creating volume 48da34d8-8cbc-4659-a584-404afafb7b0c {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:55 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-48da34d8-8cbc-4659-a584-404afafb7b0c 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b0b1c35-9362-46e4-9f68-3a97aa4f4d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3406f8f-1a6c-47b5-9575-4399e66f4763', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f535be30-de83-4ac0-a334-bb2f09023f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:55 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-48da34d8-8cbc-4659-a584-404afafb7b0c 1073741824 Jul 24 16:01:55 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:55 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume volume-c3406f8f-1a6c-47b5-9575-4399e66f4763 (c3406f8f-1a6c-47b5-9575-4399e66f4763): created successfully Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f535be30-de83-4ac0-a334-bb2f09023f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Flow 'volume_create_manager' (75456a97-ea69-40c9-908d-a33c779952f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:55 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-9b5a079e-430d-49de-bba2-7e55ef34d2f3 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Created volume successfully. Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Flow 'volume_create_manager' (bd42f007-b378-473a-8035-4550ca3bee56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c33f653-9ca0-4f0f-a97d-2213a3bbb3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c33f653-9ca0-4f0f-a97d-2213a3bbb3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-346219970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33471a16298a4c76895af2c6ddb7628a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:55Z,use_quota=True,user_id='511e6713b7e444a3b6b2f0b6aa0b5331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74c845b-d09d-475e-845f-efa59ddb91e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f74c845b-d09d-475e-845f-efa59ddb91e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e209408-8555-4545-ba5f-8ab30f3aa916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e209408-8555-4545-ba5f-8ab30f3aa916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f', 'volume_name': 'volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11963c7-33a7-476e-81a2-d904e1d8e9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11963c7-33a7-476e-81a2-d904e1d8e9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931c6ff9-fa4f-4af8-a777-3ae2c6f5cc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:55 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Volume bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f', 'volume_size': 1} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:55 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-48da34d8-8cbc-4659-a584-404afafb7b0c 1073741824" returned: 0 in 0.570s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-48da34d8-8cbc-4659-a584-404afafb7b0c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:56 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-48da34d8-8cbc-4659-a584-404afafb7b0c Jul 24 16:01:56 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:56 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-48da34d8-8cbc-4659-a584-404afafb7b0c" returned: 0 in 0.263s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.092s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-577800755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4782524c-75f4-41f0-a655-7f10fd07e4e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a87f505dc8d4580947e029b87e54c84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:53Z,use_quota=True,user_id='abaf36e09da74fe788f962b158be26b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Creating volume 4782524c-75f4-41f0-a655-7f10fd07e4e5 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:56 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4782524c-75f4-41f0-a655-7f10fd07e4e5 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:56 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4782524c-75f4-41f0-a655-7f10fd07e4e5 1073741824 Jul 24 16:01:56 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f423d9aa-f33c-4fc3-acef-deca4aee0bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48da34d8-8cbc-4659-a584-404afafb7b0c', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17d9d4c-25e3-45bd-bce6-3dfac335f735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:56 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume volume-48da34d8-8cbc-4659-a584-404afafb7b0c (48da34d8-8cbc-4659-a584-404afafb7b0c): created successfully Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17d9d4c-25e3-45bd-bce6-3dfac335f735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Flow 'volume_create_manager' (65bed296-2eb6-4499-9778-f3de03b95ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:56 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-fa5e11ca-df1d-4c12-9d9a-4f363844ed59 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Created volume successfully. Jul 24 16:01:56 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4782524c-75f4-41f0-a655-7f10fd07e4e5 1073741824" returned: 0 in 0.526s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4782524c-75f4-41f0-a655-7f10fd07e4e5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:56 devstack sudo[108497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4782524c-75f4-41f0-a655-7f10fd07e4e5 Jul 24 16:01:56 devstack sudo[108497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:57 devstack sudo[108497]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4782524c-75f4-41f0-a655-7f10fd07e4e5" returned: 0 in 0.285s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.510s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-346219970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33471a16298a4c76895af2c6ddb7628a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:01:55Z,use_quota=True,user_id='511e6713b7e444a3b6b2f0b6aa0b5331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Creating volume bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:01:57 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f823b864-22b5-4bf2-b906-06b87a7766d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4782524c-75f4-41f0-a655-7f10fd07e4e5', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:57 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f 1073741824 Jul 24 16:01:57 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229a7cbc-325b-44d9-b0d9-22b79293907b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:57 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Volume volume-4782524c-75f4-41f0-a655-7f10fd07e4e5 (4782524c-75f4-41f0-a655-7f10fd07e4e5): created successfully Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (229a7cbc-325b-44d9-b0d9-22b79293907b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Flow 'volume_create_manager' (9512c32f-2218-4b69-b7b9-f6c74b6e2866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:57 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d8b32140-b62f-48f2-8dc9-3133c1552f62 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Created volume successfully. Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "cinder-4782524c-75f4-41f0-a655-7f10fd07e4e5-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-4782524c-75f4-41f0-a655-7f10fd07e4e5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "cinder-quobyte-4782524c-75f4-41f0-a655-7f10fd07e4e5" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-quobyte-4782524c-75f4-41f0-a655-7f10fd07e4e5" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[724e7f6e-8bf6-4ad6-9d5c-21728f6d1ab7]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4782524c-75f4-41f0-a655-7f10fd07e4e5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:57 devstack sudo[108506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4782524c-75f4-41f0-a655-7f10fd07e4e5 Jul 24 16:01:57 devstack sudo[108506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:57 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f 1073741824" returned: 0 in 0.725s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:57 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f Jul 24 16:01:57 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:58 devstack sudo[108506]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4782524c-75f4-41f0-a655-7f10fd07e4e5" returned: 0 in 0.486s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4782524c-75f4-41f0-a655-7f10fd07e4e5 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:58 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4782524c-75f4-41f0-a655-7f10fd07e4e5 Jul 24 16:01:58 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:58 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f" returned: 0 in 0.308s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (931c6ff9-fa4f-4af8-a777-3ae2c6f5cc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8312f8db-2436-4323-80a6-72c298bc1499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:01:58 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Volume volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f (bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f): created successfully Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8312f8db-2436-4323-80a6-72c298bc1499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Flow 'volume_create_manager' (bd42f007-b378-473a-8035-4550ca3bee56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:01:58 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-6bfa80b7-5f21-4a4b-aad3-26d2c1e2c6e7 tempest-ProjectReaderTests-1541451379 None] Created volume successfully. Jul 24 16:01:58 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-4782524c-75f4-41f0-a655-7f10fd07e4e5" returned: 0 in 0.298s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-quobyte-4782524c-75f4-41f0-a655-7f10fd07e4e5" released by "delete_volume" :: held 0.839s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Created reservations ['bff87f6b-fca6-4bf2-9f99-037b7310389e', 'eee6633a-f938-492c-bb49-0d4b4d3fd34f', 'e8adf611-1926-4bac-a05f-5426fc651056', '4990ef85-472a-4aea-b985-586ca82e3fc8'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:58 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:01:58 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "cinder-48da34d8-8cbc-4659-a584-404afafb7b0c-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Acquiring lock "cinder-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-48da34d8-8cbc-4659-a584-404afafb7b0c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Lock "cinder-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "cinder-quobyte-48da34d8-8cbc-4659-a584-404afafb7b0c" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-quobyte-48da34d8-8cbc-4659-a584-404afafb7b0c" acquired by "delete_volume" :: waited 0.037s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8b6228-a92b-4aa0-8a84-31437f57ebfa]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-48da34d8-8cbc-4659-a584-404afafb7b0c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Acquiring lock "cinder-quobyte-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Lock "cinder-quobyte-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f" acquired by "delete_volume" :: waited 0.026s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6007a58a-ba11-49d0-91c0-586f1d24d91e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:59 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-48da34d8-8cbc-4659-a584-404afafb7b0c Jul 24 16:01:59 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:59 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.532s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:01:59 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Deleted volume successfully. Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-03d71043-d5a1-4074-84d3-c270abf63524 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-4782524c-75f4-41f0-a655-7f10fd07e4e5-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:59 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f Jul 24 16:01:59 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:59 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-48da34d8-8cbc-4659-a584-404afafb7b0c" returned: 0 in 0.471s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-48da34d8-8cbc-4659-a584-404afafb7b0c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:59 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-48da34d8-8cbc-4659-a584-404afafb7b0c Jul 24 16:01:59 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:59 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f" returned: 0 in 0.451s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:01:59 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f Jul 24 16:01:59 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:01:59 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-48da34d8-8cbc-4659-a584-404afafb7b0c" returned: 0 in 0.344s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-quobyte-48da34d8-8cbc-4659-a584-404afafb7b0c" released by "delete_volume" :: held 0.908s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:59 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f" returned: 0 in 0.284s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Lock "cinder-quobyte-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f" released by "delete_volume" :: held 0.799s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:01:59 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Created reservations ['c20a424a-8ff5-42d7-8652-844b4e90d70e', '4ba370e6-e49f-45e2-a8e2-bc78aa4bd8ee', '89d580e7-b127-42d8-a05d-1a8d8c77f4f4', 'b8861166-b7d8-4347-98d2-3549c8c8d79d'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Created reservations ['e0d2b5cf-09ff-4d3d-a626-ebc0fa1cfea1', 'a37b5362-a49c-438d-a2f9-0fed99b9a261', '747bffa6-6dd5-4d74-afa1-022efeafbe67', 'b414c62c-5c2c-4131-b3da-58e602935ffb'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:00 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:02:00 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:00 devstack sudo[108538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:02:00 devstack sudo[108538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:00 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.382s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:02:00 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Deleted volume successfully. Jul 24 16:02:00 devstack sudo[108538]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.360s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:02:00 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Deleted volume successfully. Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-da64a855-4a83-483b-85f0-e2e7992d184b tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-48da34d8-8cbc-4659-a584-404afafb7b0c-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-42481f10-b73c-4606-9c27-935b8c7e07d9 tempest-ProjectReaderTests-1541451379 None] Lock "cinder-bf6ace36-5a3a-427a-abb2-ad13b1f4bc0f-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "cinder-c3406f8f-1a6c-47b5-9575-4399e66f4763-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-c3406f8f-1a6c-47b5-9575-4399e66f4763-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "cinder-quobyte-c3406f8f-1a6c-47b5-9575-4399e66f4763" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-quobyte-c3406f8f-1a6c-47b5-9575-4399e66f4763" acquired by "delete_volume" :: waited 0.037s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:01 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe23ab2-02e4-49d0-8162-d91a67c7717a]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c3406f8f-1a6c-47b5-9575-4399e66f4763 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:01 devstack sudo[108543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c3406f8f-1a6c-47b5-9575-4399e66f4763 Jul 24 16:02:01 devstack sudo[108543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:01 devstack sudo[108543]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c3406f8f-1a6c-47b5-9575-4399e66f4763" returned: 0 in 0.524s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c3406f8f-1a6c-47b5-9575-4399e66f4763 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:01 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c3406f8f-1a6c-47b5-9575-4399e66f4763 Jul 24 16:02:01 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:02 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c3406f8f-1a6c-47b5-9575-4399e66f4763" returned: 0 in 0.247s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-quobyte-c3406f8f-1a6c-47b5-9575-4399e66f4763" released by "delete_volume" :: held 0.833s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Created reservations ['0cf84cb6-c931-4bfe-9fde-f2fa165cce66', 'c1f0798c-bcbe-4230-b228-2dad8e5d0ff1', 'dd31acd3-fa5d-4022-bda1-5b4774881925', '73ec603b-64d5-49d8-b24f-f3dd1e8d23a6'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:02 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:02:02 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "cinder-6b98d204-5c98-4ab2-8be2-929e8e1da46a-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-6b98d204-5c98-4ab2-8be2-929e8e1da46a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "cinder-quobyte-6b98d204-5c98-4ab2-8be2-929e8e1da46a" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-quobyte-6b98d204-5c98-4ab2-8be2-929e8e1da46a" acquired by "delete_volume" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0376bc47-3146-40a2-b3cd-a6013c453794]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:02 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:02 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a Jul 24 16:02:02 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.370s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:02:02 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Deleted volume successfully. Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-116f8bc0-e89c-4fc1-9d2e-92ba1fc484b6 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-c3406f8f-1a6c-47b5-9575-4399e66f4763-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:02 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a" returned: 0 in 0.431s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:02 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a Jul 24 16:02:02 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:03 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-6b98d204-5c98-4ab2-8be2-929e8e1da46a" returned: 0 in 0.295s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-quobyte-6b98d204-5c98-4ab2-8be2-929e8e1da46a" released by "delete_volume" :: held 0.785s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:03 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Created reservations ['5d492376-c70d-40b1-a305-ee9c02e32415', '5cc8e1f5-b5ea-4bb6-9c01-fda0229792d2', 'd2886596-3391-4fc1-90e4-6ff361ef415b', '5c411a0b-d0a9-4e71-a5f3-9898071a7cd3'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:03 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:02:03 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "cinder-e59a51e6-b484-41c1-bb47-5980a7632e97-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-e59a51e6-b484-41c1-bb47-5980a7632e97-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:03 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "cinder-quobyte-e59a51e6-b484-41c1-bb47-5980a7632e97" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.500s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:03 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:02:03 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Deleted volume successfully. Jul 24 16:02:03 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-quobyte-e59a51e6-b484-41c1-bb47-5980a7632e97" acquired by "delete_volume" :: waited 0.055s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e3fd3d55-c0f1-4f17-9c62-8c4059740853 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-6b98d204-5c98-4ab2-8be2-929e8e1da46a-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[615bb687-6b6c-4628-86bc-17a296b753ec]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e59a51e6-b484-41c1-bb47-5980a7632e97 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:04 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e59a51e6-b484-41c1-bb47-5980a7632e97 Jul 24 16:02:04 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:04 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e59a51e6-b484-41c1-bb47-5980a7632e97" returned: 0 in 0.437s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e59a51e6-b484-41c1-bb47-5980a7632e97 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:04 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e59a51e6-b484-41c1-bb47-5980a7632e97 Jul 24 16:02:04 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:04 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e59a51e6-b484-41c1-bb47-5980a7632e97" returned: 0 in 0.272s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-quobyte-e59a51e6-b484-41c1-bb47-5980a7632e97" released by "delete_volume" :: held 0.787s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Created reservations ['a6099027-e9e9-43da-a572-51a99efce4b0', '43e3e180-a0bc-424c-9982-4d80730dfb20', 'e2c37c3f-e1cf-4683-a311-26952e1e234f', 'ce79912b-ae4f-4f1f-83ea-9e1c54362514'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Flow 'volume_create_manager' (b24fa4cb-a976-4f9f-aaf1-57bad8201578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2816f6f0-0f11-4f54-9fc2-676eb3798bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2816f6f0-0f11-4f54-9fc2-676eb3798bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-272515961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5c4b94-a377-4946-9a45-0965bbd2c80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e988f6caeb4a4daefb3a5252504d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:02:05Z,use_quota=True,user_id='432707b8e8084740b5e5ab2d8332a6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87cbb16-8983-4859-bcd9-3c9e4b7ad349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a87cbb16-8983-4859-bcd9-3c9e4b7ad349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80767ce3-8532-4ab3-866c-988ba166fd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80767ce3-8532-4ab3-866c-988ba166fd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef5c4b94-a377-4946-9a45-0965bbd2c80a', 'volume_name': 'volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80734c01-7fe1-43a8-af55-1372c0161e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80734c01-7fe1-43a8-af55-1372c0161e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8343d07-8902-4d00-bb08-9b5b465b19b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:04 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Volume ef5c4b94-a377-4946-9a45-0965bbd2c80a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a', 'volume_size': 1} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-272515961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef5c4b94-a377-4946-9a45-0965bbd2c80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e988f6caeb4a4daefb3a5252504d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:02:05Z,use_quota=True,user_id='432707b8e8084740b5e5ab2d8332a6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Creating volume ef5c4b94-a377-4946-9a45-0965bbd2c80a {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:02:04 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:04 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a 1073741824 Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:04 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:04 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "cinder-95ad4025-9076-44e0-8c45-d12fd237e072-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:05 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:02:05 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-95ad4025-9076-44e0-8c45-d12fd237e072-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "cinder-quobyte-95ad4025-9076-44e0-8c45-d12fd237e072" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-quobyte-95ad4025-9076-44e0-8c45-d12fd237e072" acquired by "delete_volume" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75ad941-712b-4498-a176-bcf4251a5872]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-95ad4025-9076-44e0-8c45-d12fd237e072 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:05 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-95ad4025-9076-44e0-8c45-d12fd237e072 Jul 24 16:02:05 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:05 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.268s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:02:05 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Deleted volume successfully. Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e5da10e1-67b0-45b5-843e-7230886d8c39 tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-e59a51e6-b484-41c1-bb47-5980a7632e97-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:05 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a 1073741824" returned: 0 in 0.474s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:05 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a Jul 24 16:02:05 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:05 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-95ad4025-9076-44e0-8c45-d12fd237e072" returned: 0 in 0.424s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-95ad4025-9076-44e0-8c45-d12fd237e072 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:05 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-95ad4025-9076-44e0-8c45-d12fd237e072 Jul 24 16:02:05 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:05 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a" returned: 0 in 0.257s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8343d07-8902-4d00-bb08-9b5b465b19b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b70ebed-061b-448a-9d84-6a076e55d49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:05 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Volume volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a (ef5c4b94-a377-4946-9a45-0965bbd2c80a): created successfully Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b70ebed-061b-448a-9d84-6a076e55d49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Flow 'volume_create_manager' (b24fa4cb-a976-4f9f-aaf1-57bad8201578) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:05 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e8a0c246-ea2f-4e4b-984d-a0f542d738b1 tempest-SnapshotDependencyTests-1290790529 None] Created volume successfully. Jul 24 16:02:05 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-95ad4025-9076-44e0-8c45-d12fd237e072" returned: 0 in 0.271s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-quobyte-95ad4025-9076-44e0-8c45-d12fd237e072" released by "delete_volume" :: held 0.734s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Created reservations ['2848751e-bf34-4e6a-9119-ceb848e33697', '41a6e779-ef89-497b-801d-19ebd5273a2d', 'a346a9c2-1c75-46bb-be0c-a3733da05755', '93076152-7c95-44d0-b337-804a09acbc85'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:05 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:02:05 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:06 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.275s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:06 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:02:06 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Deleted volume successfully. Jul 24 16:02:06 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-40e39ae0-62c2-40f8-81e7-197dbe58d41f tempest-CreateVolumesFromSourceVolumeTest-1115781076 None] Lock "cinder-95ad4025-9076-44e0-8c45-d12fd237e072-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:07 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] Creating offline snapshot c6c3f7c4-5186-449e-8def-ef2eaab88d93 of volume ef5c4b94-a377-4946-9a45-0965bbd2c80a {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:02:07 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6e8fdc-dec6-4771-8620-286c26c21a37]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:07 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a Jul 24 16:02:07 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:07 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a" returned: 0 in 0.402s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:07 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 1G Jul 24 16:02:07 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:08 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 1G" returned: 0 in 0.414s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:08 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 Jul 24 16:02:08 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:08 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93" returned: 0 in 0.299s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:08 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 is being set with open permissions: ugo+rw Jul 24 16:02:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:08 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 Jul 24 16:02:08 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:08 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93" returned: 0 in 0.258s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:08 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.info Jul 24 16:02:08 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:08 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.info" returned: 0 in 0.287s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:08 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.info is being set with open permissions: ugo+rw Jul 24 16:02:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:08 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.info Jul 24 16:02:08 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:09 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.info" returned: 0 in 0.285s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.051s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:09 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-50590d56-195e-4032-b9b3-85cf7bed7e0f tempest-SnapshotDependencyTests-1290790529 None] Create snapshot completed successfully Jul 24 16:02:10 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:02:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Flow 'volume_create_manager' (428a8e02-d891-4ca8-a4b5-a75de698b321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0c8ddf-704e-47c7-85ea-302bd1745d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0c8ddf-704e-47c7-85ea-302bd1745d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abd77e55-07f5-47de-a6ad-f217f89f2349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03e988f6caeb4a4daefb3a5252504d83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c6c3f7c4-5186-449e-8def-ef2eaab88d93,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:02:11Z,use_quota=True,user_id='432707b8e8084740b5e5ab2d8332a6dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2471dda6-8871-45f0-bcb2-8727126744af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2471dda6-8871-45f0-bcb2-8727126744af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6499a5af-9011-4920-909e-99f4f6c27a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6499a5af-9011-4920-909e-99f4f6c27a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'abd77e55-07f5-47de-a6ad-f217f89f2349', 'volume_name': 'volume-abd77e55-07f5-47de-a6ad-f217f89f2349', 'volume_size': 1, 'snapshot_id': 'c6c3f7c4-5186-449e-8def-ef2eaab88d93'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd412575-443d-46ff-977e-4f2d9a52ba12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd412575-443d-46ff-977e-4f2d9a52ba12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990a6b2e-fc30-45bb-9877-6ff2642a72dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:11 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Volume abd77e55-07f5-47de-a6ad-f217f89f2349: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-abd77e55-07f5-47de-a6ad-f217f89f2349', 'volume_size': 1, 'snapshot_id': 'c6c3f7c4-5186-449e-8def-ef2eaab88d93'} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "cinder-quobyte-c6c3f7c4-5186-449e-8def-ef2eaab88d93-abd77e55-07f5-47de-a6ad-f217f89f2349" by "_create_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-quobyte-c6c3f7c4-5186-449e-8def-ef2eaab88d93-abd77e55-07f5-47de-a6ad-f217f89f2349" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Creating volume abd77e55-07f5-47de-a6ad-f217f89f2349 from snapshot c6c3f7c4-5186-449e-8def-ef2eaab88d93 {{(pid=88350) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "cinder-quobyte-abd77e55-07f5-47de-a6ad-f217f89f2349" by "_copy_volume_from_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-quobyte-abd77e55-07f5-47de-a6ad-f217f89f2349" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] snapshot: c6c3f7c4-5186-449e-8def-ef2eaab88d93, volume: abd77e55-07f5-47de-a6ad-f217f89f2349, {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:403}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9788b05b-71c7-4256-bd31-db47f1a6b3bf]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:11 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 Jul 24 16:02:11 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:11 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93" returned: 0 in 0.416s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Creating direct copy from snapshot {{(pid=88350) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:430}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[875bebce-b6a9-4c39-8816-93f8b101e078]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:11 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a Jul 24 16:02:11 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:11 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a" returned: 0 in 0.383s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG cinder.utils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Path /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-abd77e55-07f5-47de-a6ad-f217f89f2349 not found in is_blk_device check {{(pid=88350) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 24 16:02:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-abd77e55-07f5-47de-a6ad-f217f89f2349 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:12 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-abd77e55-07f5-47de-a6ad-f217f89f2349 Jul 24 16:02:12 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:16 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-abd77e55-07f5-47de-a6ad-f217f89f2349" returned: 0 in 4.435s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[88078537-e711-4b57-b26b-dbd93ffec493]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:16 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a Jul 24 16:02:16 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (90772057-2a5b-4a64-86c1-40266478ea6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53bee51-33e6-4df4-8689-ebcf18c6527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d53bee51-33e6-4df4-8689-ebcf18c6527c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547947840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddb7701-33a2-49f7-ac5e-babe2c3aa6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:02:17Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b259f8-0766-4408-9850-5d8cabac71a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b259f8-0766-4408-9850-5d8cabac71a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ffbbf3-2433-4e6e-a024-924d46118397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6ffbbf3-2433-4e6e-a024-924d46118397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bddb7701-33a2-49f7-ac5e-babe2c3aa6cc', 'volume_name': 'volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f01ab6f-5cb0-40b2-98b7-702e883c5a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f01ab6f-5cb0-40b2-98b7-702e883c5a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d334495-42ff-420f-a665-3df6b97919aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:16 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Volume bddb7701-33a2-49f7-ac5e-babe2c3aa6cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc', 'volume_size': 1} Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:16 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a" returned: 0 in 0.524s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG cinder.image.image_utils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Image conversion details: src /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a, size 1024.00 MB, duration 4.44 sec, destination /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-abd77e55-07f5-47de-a6ad-f217f89f2349 {{(pid=88350) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 24 16:02:16 devstack cinder-volume[88350]: INFO cinder.image.image_utils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Converted 1024.00 MB image at 230.83 MB/s Jul 24 16:02:16 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-abd77e55-07f5-47de-a6ad-f217f89f2349 is being set with open permissions: ugo+rw Jul 24 16:02:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-abd77e55-07f5-47de-a6ad-f217f89f2349 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:16 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-abd77e55-07f5-47de-a6ad-f217f89f2349 Jul 24 16:02:16 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:17 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-abd77e55-07f5-47de-a6ad-f217f89f2349" returned: 0 in 0.241s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-quobyte-abd77e55-07f5-47de-a6ad-f217f89f2349" released by "_copy_volume_from_snapshot" :: held 6.112s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-quobyte-c6c3f7c4-5186-449e-8def-ef2eaab88d93-abd77e55-07f5-47de-a6ad-f217f89f2349" released by "_create_volume_from_snapshot" :: held 6.144s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.163s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.491s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547947840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bddb7701-33a2-49f7-ac5e-babe2c3aa6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:02:17Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Creating volume bddb7701-33a2-49f7-ac5e-babe2c3aa6cc {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:02:17 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:17 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc 1073741824 Jul 24 16:02:17 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990a6b2e-fc30-45bb-9877-6ff2642a72dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abd77e55-07f5-47de-a6ad-f217f89f2349', 'volume_size': 1, 'snapshot_id': 'c6c3f7c4-5186-449e-8def-ef2eaab88d93'}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03d4c9d-59e4-4ab3-92c1-6d1a6a442a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:17 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Volume volume-abd77e55-07f5-47de-a6ad-f217f89f2349 (abd77e55-07f5-47de-a6ad-f217f89f2349): created successfully Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c03d4c9d-59e4-4ab3-92c1-6d1a6a442a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Flow 'volume_create_manager' (428a8e02-d891-4ca8-a4b5-a75de698b321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:17 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-bc9d95a2-98f2-4e9f-8c3b-24b6031b95a8 tempest-SnapshotDependencyTests-1290790529 None] Created volume successfully. Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "cinder-c6c3f7c4-5186-449e-8def-ef2eaab88d93-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-c6c3f7c4-5186-449e-8def-ef2eaab88d93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "cinder-quobyte-ef5c4b94-a377-4946-9a45-0965bbd2c80a" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-quobyte-ef5c4b94-a377-4946-9a45-0965bbd2c80a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "cinder-quobyte-c6c3f7c4-5186-449e-8def-ef2eaab88d93" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-quobyte-c6c3f7c4-5186-449e-8def-ef2eaab88d93" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Deleting offline snapshot c6c3f7c4-5186-449e-8def-ef2eaab88d93 of volume ef5c4b94-a377-4946-9a45-0965bbd2c80a {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] snapshot_file for this snap is: volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:02:17 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc 1073741824" returned: 0 in 0.476s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa740ca8-2bf5-4e9b-8b7c-2b0c78047a8e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:17 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc Jul 24 16:02:17 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:17 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 Jul 24 16:02:17 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:18 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc" returned: 0 in 0.244s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:02:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d334495-42ff-420f-a665-3df6b97919aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c70caa2-397a-4454-a334-e0d42b3e7f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:18 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Volume volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc (bddb7701-33a2-49f7-ac5e-babe2c3aa6cc): created successfully Jul 24 16:02:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c70caa2-397a-4454-a334-e0d42b3e7f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:18 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (90772057-2a5b-4a64-86c1-40266478ea6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:18 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-94ddc898-d68f-41af-a2a6-f0c7b45afd6f tempest-ProjectMemberTests-556951607 None] Created volume successfully. Jul 24 16:02:18 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93" returned: 0 in 0.359s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:18 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:02:18 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[087a9921-254f-45ab-89db-303e8dac7682]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:18 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a Jul 24 16:02:18 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:18 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a" returned: 0 in 0.338s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:18 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 Jul 24 16:02:18 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:18 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93" returned: 0 in 0.348s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:18 devstack sudo[108722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93 Jul 24 16:02:18 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:19 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a.c6c3f7c4-5186-449e-8def-ef2eaab88d93" returned: 0 in 0.274s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-quobyte-c6c3f7c4-5186-449e-8def-ef2eaab88d93" released by "_delete_snapshot" :: held 1.424s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] Creating offline snapshot f4f11d8e-71da-4afc-955e-036d980e59d4 of volume bddb7701-33a2-49f7-ac5e-babe2c3aa6cc {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-quobyte-ef5c4b94-a377-4946-9a45-0965bbd2c80a" released by "delete_snapshot" :: held 1.458s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[48729fea-c132-4472-ac61-04bc2dfecac3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Created reservations ['9bc53817-f34d-4f99-9f9b-bad2a8859c38', '59abe980-af3c-4dcb-bc8e-89a06abb77b3', '573ad3b7-a13a-4020-94f4-e9555358b194', 'cf630f8b-9b19-458e-90b7-3651fd87e2b2'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:19 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Delete snapshot completed successfully. Jul 24 16:02:19 devstack sudo[108725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc Jul 24 16:02:19 devstack sudo[108725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3f2a1038-fa16-43bb-8479-7aeb116eeaac tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-c6c3f7c4-5186-449e-8def-ef2eaab88d93-delete_snapshot" released by "delete_snapshot" :: held 1.608s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:19 devstack sudo[108725]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc" returned: 0 in 0.355s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:19 devstack sudo[108730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4 1G Jul 24 16:02:19 devstack sudo[108730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "cinder-ef5c4b94-a377-4946-9a45-0965bbd2c80a-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-ef5c4b94-a377-4946-9a45-0965bbd2c80a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "cinder-quobyte-ef5c4b94-a377-4946-9a45-0965bbd2c80a" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-quobyte-ef5c4b94-a377-4946-9a45-0965bbd2c80a" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1387dbc-f601-4a2c-bfd6-3f4bad61ce16]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:19 devstack sudo[108730]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4 1G" returned: 0 in 0.431s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:19 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4 Jul 24 16:02:19 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:20 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a Jul 24 16:02:20 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:20 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4" returned: 0 in 0.307s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:20 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4 is being set with open permissions: ugo+rw Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:20 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4 Jul 24 16:02:20 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:20 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a" returned: 0 in 0.380s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:20 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a Jul 24 16:02:20 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:20 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4" returned: 0 in 0.244s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:20 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-ef5c4b94-a377-4946-9a45-0965bbd2c80a" returned: 0 in 0.250s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:20 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.info Jul 24 16:02:20 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-quobyte-ef5c4b94-a377-4946-9a45-0965bbd2c80a" released by "delete_volume" :: held 0.693s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Created reservations ['a339f0d5-7efa-4907-bc4b-20b3f20f0fc9', '28b2c578-ae31-4b96-8860-fbda2c3cb764', '05d9ccdd-b8aa-4479-98e2-036223e6c755', '215b6fd4-7eb3-40f8-bab5-109de29aa339'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:20 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:02:20 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:20 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.info" returned: 0 in 0.262s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:20 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.info is being set with open permissions: ugo+rw Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:20 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.info Jul 24 16:02:20 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:20 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.277s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:02:20 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "cinder-abd77e55-07f5-47de-a6ad-f217f89f2349-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:20 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Deleted volume successfully. Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-62cc3385-7e7b-498a-9e36-90e88c20c020 tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-ef5c4b94-a377-4946-9a45-0965bbd2c80a-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-abd77e55-07f5-47de-a6ad-f217f89f2349-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:21 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.info" returned: 0 in 0.261s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "cinder-quobyte-abd77e55-07f5-47de-a6ad-f217f89f2349" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:21 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-57d95f5d-75b5-4a91-8e4b-4f64c428dd95 tempest-ProjectMemberTests-556951607 None] Create snapshot completed successfully Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-quobyte-abd77e55-07f5-47de-a6ad-f217f89f2349" acquired by "delete_volume" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[090e26d4-514f-493c-93fa-f176f164d923]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-abd77e55-07f5-47de-a6ad-f217f89f2349 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-f4f11d8e-71da-4afc-955e-036d980e59d4-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Lock "cinder-f4f11d8e-71da-4afc-955e-036d980e59d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-f4f11d8e-71da-4afc-955e-036d980e59d4" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:21 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-abd77e55-07f5-47de-a6ad-f217f89f2349 Jul 24 16:02:21 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-f4f11d8e-71da-4afc-955e-036d980e59d4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Deleting offline snapshot f4f11d8e-71da-4afc-955e-036d980e59d4 of volume bddb7701-33a2-49f7-ac5e-babe2c3aa6cc {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] snapshot_file for this snap is: volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92b2848-5ad4-439d-8242-0cac64172f7e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:21 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4 Jul 24 16:02:21 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:21 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-abd77e55-07f5-47de-a6ad-f217f89f2349" returned: 0 in 0.417s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-abd77e55-07f5-47de-a6ad-f217f89f2349 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:21 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-abd77e55-07f5-47de-a6ad-f217f89f2349 Jul 24 16:02:21 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:21 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4" returned: 0 in 0.391s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4059d5a-aecb-4a7c-8030-0c63747545fa]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:21 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-abd77e55-07f5-47de-a6ad-f217f89f2349" returned: 0 in 0.253s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-quobyte-abd77e55-07f5-47de-a6ad-f217f89f2349" released by "delete_volume" :: held 0.718s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:21 devstack sudo[108773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc Jul 24 16:02:21 devstack sudo[108773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Created reservations ['53091f36-a849-4e59-8b0f-fdda887d5b04', '20c7ce4a-4a1a-451e-8337-058e3fdb3358', '313b1f86-7afb-4f25-93b8-2e1e1cfb039c', 'c776bc98-432f-4e33-9712-d4326d08060d'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:21 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:02:21 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:22 devstack sudo[108773]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc" returned: 0 in 0.392s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:22 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4 Jul 24 16:02:22 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:22 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.242s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:22 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:02:22 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Deleted volume successfully. Jul 24 16:02:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-a70c83be-3c19-4e0d-b1a3-1e8c93b22e3d tempest-SnapshotDependencyTests-1290790529 None] Lock "cinder-abd77e55-07f5-47de-a6ad-f217f89f2349-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:22 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4" returned: 0 in 0.386s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:22 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4 Jul 24 16:02:22 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:22 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc.f4f11d8e-71da-4afc-955e-036d980e59d4" returned: 0 in 0.252s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-f4f11d8e-71da-4afc-955e-036d980e59d4" released by "_delete_snapshot" :: held 1.539s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc" released by "delete_snapshot" :: held 1.562s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:22 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Created reservations ['df0d2788-6582-4b0c-9909-4268904083eb', '9190077d-1407-42b2-8b90-62b8897d067a', '9cf61b61-f55b-4e2f-8329-a177eb2c6651', '52ece107-bda2-4235-9618-aff6dd14bc02'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:22 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Delete snapshot completed successfully. Jul 24 16:02:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6b54894f-c09a-424d-bde9-dd5bb124f72c tempest-ProjectMemberTests-556951607 None] Lock "cinder-f4f11d8e-71da-4afc-955e-036d980e59d4-delete_snapshot" released by "delete_snapshot" :: held 1.707s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Lock "cinder-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:23 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f108034-228a-46ab-b7f5-38cb9e2f048f]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:23 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc Jul 24 16:02:23 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:23 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc" returned: 0 in 0.432s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:23 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc Jul 24 16:02:23 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:24 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc" returned: 0 in 0.254s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc" released by "delete_volume" :: held 0.741s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:24 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Created reservations ['02bcac26-0dfc-45b8-ab9d-252ca674b795', '367dcd3b-d20f-4855-984b-dd36f8a4530d', '9e7b28ce-9832-4eea-9bb2-3933c407f657', 'e8e0fbe0-ec9a-4fd6-a0bf-7b0adb9006f4'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:24 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:24 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:02:24 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:24 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:24 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.298s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:24 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:02:24 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Deleted volume successfully. Jul 24 16:02:24 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-6027391a-b884-4846-8249-482505bdf232 tempest-ProjectMemberTests-556951607 None] Lock "cinder-bddb7701-33a2-49f7-ac5e-babe2c3aa6cc-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (fc81d15e-cc01-49b9-bc21-4f972a573979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4f299c-a2c6-4ecc-b86b-42494ed5bb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a4f299c-a2c6-4ecc-b86b-42494ed5bb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-22352947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5546ba0-9837-4f42-836a-7f39b911efef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:02:25Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11058684-5ff8-4cb2-825f-a00695a33b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11058684-5ff8-4cb2-825f-a00695a33b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a18d21-b3aa-434a-8e03-a85a44970578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a18d21-b3aa-434a-8e03-a85a44970578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5546ba0-9837-4f42-836a-7f39b911efef', 'volume_name': 'volume-e5546ba0-9837-4f42-836a-7f39b911efef', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89432a70-c497-4b3b-b138-e4a120c3240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89432a70-c497-4b3b-b138-e4a120c3240f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438eccef-af58-4c4a-bbf6-e27ca29f5df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:25 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Volume e5546ba0-9837-4f42-836a-7f39b911efef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5546ba0-9837-4f42-836a-7f39b911efef', 'volume_size': 1} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-22352947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5546ba0-9837-4f42-836a-7f39b911efef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:02:25Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Creating volume e5546ba0-9837-4f42-836a-7f39b911efef {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:02:25 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:25 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef 1073741824 Jul 24 16:02:25 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:25 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef 1073741824" returned: 0 in 0.458s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:25 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:25 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef Jul 24 16:02:25 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:26 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef" returned: 0 in 0.330s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:26 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:02:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438eccef-af58-4c4a-bbf6-e27ca29f5df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5546ba0-9837-4f42-836a-7f39b911efef', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09843b00-c642-470a-9367-774bb0df98b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:26 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Volume volume-e5546ba0-9837-4f42-836a-7f39b911efef (e5546ba0-9837-4f42-836a-7f39b911efef): created successfully Jul 24 16:02:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09843b00-c642-470a-9367-774bb0df98b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (fc81d15e-cc01-49b9-bc21-4f972a573979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:26 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-0a45b93a-985f-4649-b80e-6c3867f681ad tempest-ProjectMemberTests-556951607 None] Created volume successfully. Jul 24 16:02:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] Creating offline snapshot 68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 of volume e5546ba0-9837-4f42-836a-7f39b911efef {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:02:27 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa4b366-ab26-4c11-99be-7de06fe25824]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:27 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef Jul 24 16:02:27 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:27 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef" returned: 0 in 0.371s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:27 devstack sudo[108818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 1G Jul 24 16:02:27 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:28 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 1G" returned: 0 in 0.410s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5546ba0-9837-4f42-836a-7f39b911efef -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:28 devstack sudo[108824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5546ba0-9837-4f42-836a-7f39b911efef -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 Jul 24 16:02:28 devstack sudo[108824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:28 devstack sudo[108824]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5546ba0-9837-4f42-836a-7f39b911efef -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2" returned: 0 in 0.339s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:28 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 is being set with open permissions: ugo+rw Jul 24 16:02:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:28 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 Jul 24 16:02:28 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:28 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2" returned: 0 in 0.311s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:28 devstack sudo[108832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.info Jul 24 16:02:28 devstack sudo[108832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:29 devstack sudo[108832]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.info" returned: 0 in 0.254s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:29 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.info is being set with open permissions: ugo+rw Jul 24 16:02:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:29 devstack sudo[108835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.info Jul 24 16:02:29 devstack sudo[108835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:29 devstack sudo[108835]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.info" returned: 0 in 0.270s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.059s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:29 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d3240aaf-3d4d-47a4-b603-a224514fb389 tempest-ProjectMemberTests-556951607 None] Create snapshot completed successfully Jul 24 16:02:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Lock "cinder-68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-e5546ba0-9837-4f42-836a-7f39b911efef" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-e5546ba0-9837-4f42-836a-7f39b911efef" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Deleting offline snapshot 68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 of volume e5546ba0-9837-4f42-836a-7f39b911efef {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:02:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] snapshot_file for this snap is: volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:02:30 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f67717-4e98-470e-839d-d0f489b3abb6]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:30 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 Jul 24 16:02:30 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:30 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2" returned: 0 in 0.399s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5546ba0-9837-4f42-836a-7f39b911efef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:02:31 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e1bda4-7aad-4660-98d6-dc919523d9fa]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:31 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef Jul 24 16:02:31 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:31 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef" returned: 0 in 0.385s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:31 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 Jul 24 16:02:31 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:31 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2" returned: 0 in 0.334s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:31 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2 Jul 24 16:02:31 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:31 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef.68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2" returned: 0 in 0.236s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2" released by "_delete_snapshot" :: held 1.467s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-e5546ba0-9837-4f42-836a-7f39b911efef" released by "delete_snapshot" :: held 1.499s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:32 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Created reservations ['c67d3786-7e52-44f7-965f-682d0cad9711', 'dfd666c6-ad34-465d-b5cd-08733198856b', '0415ddf5-e8a2-4e70-be23-e4bb28b4b785', '8a053359-50c4-4e61-a77e-f5882dddcf0d'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:32 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Delete snapshot completed successfully. Jul 24 16:02:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7130782b-c0d9-4252-9d77-326668f81193 tempest-ProjectMemberTests-556951607 None] Lock "cinder-68dbe14b-52a7-4c3b-a9d4-edbc8d2104d2-delete_snapshot" released by "delete_snapshot" :: held 1.632s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-e5546ba0-9837-4f42-836a-7f39b911efef-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Lock "cinder-e5546ba0-9837-4f42-836a-7f39b911efef-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-e5546ba0-9837-4f42-836a-7f39b911efef" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-e5546ba0-9837-4f42-836a-7f39b911efef" acquired by "delete_volume" :: waited 0.013s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:32 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e09c22-f84c-4ce0-85aa-ce57154697ff]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:32 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef Jul 24 16:02:32 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:33 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef" returned: 0 in 0.348s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:33 devstack sudo[108863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef Jul 24 16:02:33 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:33 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-e5546ba0-9837-4f42-836a-7f39b911efef" returned: 0 in 0.245s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-e5546ba0-9837-4f42-836a-7f39b911efef" released by "delete_volume" :: held 0.647s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:33 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Created reservations ['4a6d400b-f54b-4410-b7e0-cfafe38525bc', 'd3d23f9f-a443-47b7-9967-459f85574d65', '49177b8c-d397-4a40-b8d7-4d71a2bc3005', '14068cb2-2a5c-4c24-bcb4-9fe1cb09e84f'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:33 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:02:33 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:33 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.264s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:33 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:02:33 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Deleted volume successfully. Jul 24 16:02:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b8e62bb2-9c93-4233-93f8-0fd5e15a81ca tempest-ProjectMemberTests-556951607 None] Lock "cinder-e5546ba0-9837-4f42-836a-7f39b911efef-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (04272694-a280-4371-9cb1-9e3f4d8c67a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f22342-9889-4774-a262-8b3aee1dfb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f22342-9889-4774-a262-8b3aee1dfb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278133642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ee513c-f093-436f-a511-ebfc2a8ee920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:02:34Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419818e0-fa85-4ee4-98e5-401ba15026ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419818e0-fa85-4ee4-98e5-401ba15026ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39fbdab7-d428-4055-9f9f-1419c0d96453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39fbdab7-d428-4055-9f9f-1419c0d96453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ee513c-f093-436f-a511-ebfc2a8ee920', 'volume_name': 'volume-20ee513c-f093-436f-a511-ebfc2a8ee920', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3022f332-d28f-4c29-8e17-df93e71ddacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3022f332-d28f-4c29-8e17-df93e71ddacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2341f1-d434-4c91-88ff-2cb4bb287804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:34 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Volume 20ee513c-f093-436f-a511-ebfc2a8ee920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ee513c-f093-436f-a511-ebfc2a8ee920', 'volume_size': 1} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278133642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ee513c-f093-436f-a511-ebfc2a8ee920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:02:34Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Creating volume 20ee513c-f093-436f-a511-ebfc2a8ee920 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:02:34 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:34 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920 1073741824 Jul 24 16:02:34 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:34 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920 1073741824" returned: 0 in 0.399s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:34 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920 Jul 24 16:02:34 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:35 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920" returned: 0 in 0.237s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:02:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de2341f1-d434-4c91-88ff-2cb4bb287804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ee513c-f093-436f-a511-ebfc2a8ee920', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5e441b-676c-441a-9edc-dd1b71777c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:35 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Volume volume-20ee513c-f093-436f-a511-ebfc2a8ee920 (20ee513c-f093-436f-a511-ebfc2a8ee920): created successfully Jul 24 16:02:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c5e441b-676c-441a-9edc-dd1b71777c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:35 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (04272694-a280-4371-9cb1-9e3f4d8c67a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:35 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3f4a9af4-f69a-44e7-9604-c229e4d19efd tempest-ProjectMemberTests-556951607 None] Created volume successfully. Jul 24 16:02:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:35 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] Creating offline snapshot aa3dcacc-91e5-4008-9832-290b7f88e2cb of volume 20ee513c-f093-436f-a511-ebfc2a8ee920 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:02:35 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d81e057-86cb-485d-847a-26ef7ee54d99]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:35 devstack sudo[108878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920 Jul 24 16:02:35 devstack sudo[108878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:35 devstack sudo[108878]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920" returned: 0 in 0.357s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:35 devstack sudo[108883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb 1G Jul 24 16:02:35 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:36 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb 1G" returned: 0 in 0.378s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ee513c-f093-436f-a511-ebfc2a8ee920 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:36 devstack sudo[108889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ee513c-f093-436f-a511-ebfc2a8ee920 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb Jul 24 16:02:36 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:36 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20ee513c-f093-436f-a511-ebfc2a8ee920 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb" returned: 0 in 0.293s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:36 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb is being set with open permissions: ugo+rw Jul 24 16:02:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:36 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb Jul 24 16:02:36 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:36 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb" returned: 0 in 0.241s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:36 devstack sudo[108900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.info Jul 24 16:02:36 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:37 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.info" returned: 0 in 0.267s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:37 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.info is being set with open permissions: ugo+rw Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:37 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.info Jul 24 16:02:37 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:37 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.info" returned: 0 in 0.239s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.853s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:37 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-121946cc-fa3c-4131-b59e-fe206fde338f tempest-ProjectMemberTests-556951607 None] Create snapshot completed successfully Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-aa3dcacc-91e5-4008-9832-290b7f88e2cb-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Lock "cinder-aa3dcacc-91e5-4008-9832-290b7f88e2cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-20ee513c-f093-436f-a511-ebfc2a8ee920" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-20ee513c-f093-436f-a511-ebfc2a8ee920" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-aa3dcacc-91e5-4008-9832-290b7f88e2cb" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-aa3dcacc-91e5-4008-9832-290b7f88e2cb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Deleting offline snapshot aa3dcacc-91e5-4008-9832-290b7f88e2cb of volume 20ee513c-f093-436f-a511-ebfc2a8ee920 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] snapshot_file for this snap is: volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30b22a5-f0f4-46a1-b8f5-cde909135e35]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:37 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb Jul 24 16:02:37 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:37 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb" returned: 0 in 0.345s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20ee513c-f093-436f-a511-ebfc2a8ee920(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:02:38 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c0239c-ba6d-41f0-bfdc-7e12c9fa6a55]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:38 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920 Jul 24 16:02:38 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:38 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920" returned: 0 in 0.338s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:38 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb Jul 24 16:02:38 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:38 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb" returned: 0 in 0.321s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:38 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb Jul 24 16:02:38 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:38 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920.aa3dcacc-91e5-4008-9832-290b7f88e2cb" returned: 0 in 0.240s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:38 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-aa3dcacc-91e5-4008-9832-290b7f88e2cb" released by "_delete_snapshot" :: held 1.335s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:38 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-20ee513c-f093-436f-a511-ebfc2a8ee920" released by "delete_snapshot" :: held 1.359s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:39 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Created reservations ['907c0882-3cd9-4e3a-9af9-e3a40a61b697', '2b23e700-0466-44f1-97e2-96b27d2587df', 'bf99ed43-526a-4c79-9ed9-3d2f72fbdf15', '6dc24959-df83-4d56-8136-7d1a337fd19a'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:39 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Delete snapshot completed successfully. Jul 24 16:02:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-2bad8f57-7ac1-4b50-b3b5-25643d5403b8 tempest-ProjectMemberTests-556951607 None] Lock "cinder-aa3dcacc-91e5-4008-9832-290b7f88e2cb-delete_snapshot" released by "delete_snapshot" :: held 1.489s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-20ee513c-f093-436f-a511-ebfc2a8ee920-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Lock "cinder-20ee513c-f093-436f-a511-ebfc2a8ee920-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-20ee513c-f093-436f-a511-ebfc2a8ee920" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-20ee513c-f093-436f-a511-ebfc2a8ee920" acquired by "delete_volume" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:39 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf6ddd5-e61f-4be6-ad43-2af6287031c3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:39 devstack sudo[108924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920 Jul 24 16:02:39 devstack sudo[108924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 16:02:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:40 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:02:40 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:40 devstack sudo[108924]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920" returned: 0 in 0.364s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:40 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920 Jul 24 16:02:40 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:40 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.243s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 16:02:40 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-20ee513c-f093-436f-a511-ebfc2a8ee920" returned: 0 in 0.244s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-20ee513c-f093-436f-a511-ebfc2a8ee920" released by "delete_volume" :: held 0.662s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Created reservations ['48ad98b2-844a-4889-8806-88fd6607bf1c', '09ebf7d3-8f10-4cb9-b3fb-2c9ff61e4b62', 'a450d2df-0029-43cf-98dc-4f48659223da', 'bed16a5f-8e1d-4931-a3cc-03083a13ee7b'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:40 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:02:40 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:40 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.234s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:02:40 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Deleted volume successfully. Jul 24 16:02:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-231b67fd-c6c2-4ced-9eca-3c5458025f3e tempest-ProjectMemberTests-556951607 None] Lock "cinder-20ee513c-f093-436f-a511-ebfc2a8ee920-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (e92afe11-6ead-4f81-9dd2-4c6cf770cb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a34daa-24fe-4f94-aa77-81280f2fcf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a34daa-24fe-4f94-aa77-81280f2fcf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2133995263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8223b717-7a2f-41ef-83a8-78c32e40fd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:02:41Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9493209-2dfa-4cc3-8186-56c7beeb6dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9493209-2dfa-4cc3-8186-56c7beeb6dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961e5c3c-5860-4246-b198-df5b23684980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961e5c3c-5860-4246-b198-df5b23684980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8223b717-7a2f-41ef-83a8-78c32e40fd4a', 'volume_name': 'volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0b4620-6871-401c-b417-b6fbb466c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0b4620-6871-401c-b417-b6fbb466c752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9869357-6786-4923-8dbb-52f9e74d90b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:41 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Volume 8223b717-7a2f-41ef-83a8-78c32e40fd4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a', 'volume_size': 1} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2133995263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8223b717-7a2f-41ef-83a8-78c32e40fd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:02:41Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Creating volume 8223b717-7a2f-41ef-83a8-78c32e40fd4a {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:02:41 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:41 devstack sudo[108939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a 1073741824 Jul 24 16:02:41 devstack sudo[108939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:41 devstack sudo[108939]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a 1073741824" returned: 0 in 0.392s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:41 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a Jul 24 16:02:41 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:42 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a" returned: 0 in 0.231s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:02:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9869357-6786-4923-8dbb-52f9e74d90b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89f9fd1-eeaa-4e99-b389-cc0c78178fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:42 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Volume volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a (8223b717-7a2f-41ef-83a8-78c32e40fd4a): created successfully Jul 24 16:02:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d89f9fd1-eeaa-4e99-b389-cc0c78178fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:42 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (e92afe11-6ead-4f81-9dd2-4c6cf770cb74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:42 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1d558fcd-a64a-4e6e-8b98-6cbbe03439f7 tempest-ProjectMemberTests-556951607 None] Created volume successfully. Jul 24 16:02:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:42 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] Creating offline snapshot bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 of volume 8223b717-7a2f-41ef-83a8-78c32e40fd4a {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:02:42 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2824170c-706c-4fae-be49-0fc9f8cab4f8]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:42 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a Jul 24 16:02:42 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:42 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a" returned: 0 in 0.360s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:42 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 1G Jul 24 16:02:42 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:43 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 1G" returned: 0 in 0.372s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:43 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 Jul 24 16:02:43 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:43 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4" returned: 0 in 0.284s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:43 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 is being set with open permissions: ugo+rw Jul 24 16:02:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:43 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 Jul 24 16:02:43 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:43 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4" returned: 0 in 0.237s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:43 devstack sudo[108966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.info Jul 24 16:02:43 devstack sudo[108966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:44 devstack sudo[108966]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.info" returned: 0 in 0.257s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:44 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.info is being set with open permissions: ugo+rw Jul 24 16:02:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:44 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.info Jul 24 16:02:44 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:44 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.info" returned: 0 in 0.259s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:44 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-742d3afb-2c54-4b35-8567-f1470333d3eb tempest-ProjectMemberTests-556951607 None] Create snapshot completed successfully Jul 24 16:02:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-bb11cc8d-24a5-4fc2-843c-6b33f7c978d4-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Lock "cinder-bb11cc8d-24a5-4fc2-843c-6b33f7c978d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-8223b717-7a2f-41ef-83a8-78c32e40fd4a" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-8223b717-7a2f-41ef-83a8-78c32e40fd4a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-bb11cc8d-24a5-4fc2-843c-6b33f7c978d4" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-bb11cc8d-24a5-4fc2-843c-6b33f7c978d4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Deleting offline snapshot bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 of volume 8223b717-7a2f-41ef-83a8-78c32e40fd4a {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:02:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] snapshot_file for this snap is: volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:02:44 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a22ad9f-7499-430f-8762-a36b5b854960]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:44 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 Jul 24 16:02:44 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:45 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4" returned: 0 in 0.356s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:45 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:02:45 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66c4da4-5aca-4167-bc91-297710794306]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:45 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a Jul 24 16:02:45 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:45 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a" returned: 0 in 0.351s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:45 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 Jul 24 16:02:45 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:45 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4" returned: 0 in 0.330s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:45 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4 Jul 24 16:02:45 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:45 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a.bb11cc8d-24a5-4fc2-843c-6b33f7c978d4" returned: 0 in 0.241s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-bb11cc8d-24a5-4fc2-843c-6b33f7c978d4" released by "_delete_snapshot" :: held 1.365s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-8223b717-7a2f-41ef-83a8-78c32e40fd4a" released by "delete_snapshot" :: held 1.386s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:46 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Created reservations ['29ff54ad-83f0-4778-89d6-4e77bf0260ec', '736340a4-2afa-47c1-9e83-06056ccd7c2f', '015c680d-8e3a-4d96-a5bb-e9c0b8781c0d', '3af9a432-49ac-472c-b3e3-9e04eaf55e89'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:46 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Delete snapshot completed successfully. Jul 24 16:02:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-7279dfd6-899c-4cef-8f89-3b9fdaa25add tempest-ProjectMemberTests-556951607 None] Lock "cinder-bb11cc8d-24a5-4fc2-843c-6b33f7c978d4-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-8223b717-7a2f-41ef-83a8-78c32e40fd4a-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Lock "cinder-8223b717-7a2f-41ef-83a8-78c32e40fd4a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:46 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=174,cinder:SELECT=155,cinder:INSERT=49,cinder:DELETE=19 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 16:02:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-8223b717-7a2f-41ef-83a8-78c32e40fd4a" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-8223b717-7a2f-41ef-83a8-78c32e40fd4a" acquired by "delete_volume" :: waited 0.028s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:46 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c260be-dc3b-4379-8eb9-ed6d8901f29b]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:46 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a Jul 24 16:02:46 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:47 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a" returned: 0 in 0.370s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:47 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a Jul 24 16:02:47 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:47 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8223b717-7a2f-41ef-83a8-78c32e40fd4a" returned: 0 in 0.239s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-8223b717-7a2f-41ef-83a8-78c32e40fd4a" released by "delete_volume" :: held 0.679s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:47 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=207,cinder:SELECT=124,cinder:INSERT=46,cinder:DELETE=15 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 16:02:47 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Created reservations ['63a76995-7a51-4af2-83e0-77f111a06c0b', '97ad94e8-2667-4b2b-950d-3d381413f02a', 'a68f602f-853f-4d63-b523-a8152d2ff73b', 'e1d2ba0b-1142-4c27-9472-cff2756a38c5'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:47 devstack sudo[108999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:02:47 devstack sudo[108999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:47 devstack sudo[108999]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.259s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:47 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:02:47 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Deleted volume successfully. Jul 24 16:02:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-12f8ab05-2eff-4e82-87f5-4d686b6badf2 tempest-ProjectMemberTests-556951607 None] Lock "cinder-8223b717-7a2f-41ef-83a8-78c32e40fd4a-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (0c17b60f-987b-422b-a7c5-e47b1e7937d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c649601a-cad6-4930-b5e9-72553de96e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c649601a-cad6-4930-b5e9-72553de96e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1459866855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49247e00-da21-48b2-8ed7-b0b721db254c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:02:48Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748169d6-201e-41b0-b2b3-b19495a6f844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748169d6-201e-41b0-b2b3-b19495a6f844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648ac193-e04e-4086-8f28-f007a3447c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648ac193-e04e-4086-8f28-f007a3447c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49247e00-da21-48b2-8ed7-b0b721db254c', 'volume_name': 'volume-49247e00-da21-48b2-8ed7-b0b721db254c', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd91ce35-ddb5-4f6d-876f-80d52a175c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd91ce35-ddb5-4f6d-876f-80d52a175c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e8ff46-78be-470f-8a70-2cffda318aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:48 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Volume 49247e00-da21-48b2-8ed7-b0b721db254c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49247e00-da21-48b2-8ed7-b0b721db254c', 'volume_size': 1} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1459866855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49247e00-da21-48b2-8ed7-b0b721db254c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:02:48Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Creating volume 49247e00-da21-48b2-8ed7-b0b721db254c {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:02:48 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:48 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c 1073741824 Jul 24 16:02:48 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:48 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c 1073741824" returned: 0 in 0.416s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:48 devstack sudo[109007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c Jul 24 16:02:48 devstack sudo[109007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:49 devstack sudo[109007]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c" returned: 0 in 0.236s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:02:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e8ff46-78be-470f-8a70-2cffda318aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49247e00-da21-48b2-8ed7-b0b721db254c', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b887d8-e80d-4d2c-8a6d-e1e66ef9c691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:49 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Volume volume-49247e00-da21-48b2-8ed7-b0b721db254c (49247e00-da21-48b2-8ed7-b0b721db254c): created successfully Jul 24 16:02:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b887d8-e80d-4d2c-8a6d-e1e66ef9c691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:49 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (0c17b60f-987b-422b-a7c5-e47b1e7937d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:49 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-4ffdb852-9235-476c-98ee-b1ded4802679 tempest-ProjectMemberTests-556951607 None] Created volume successfully. Jul 24 16:02:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:49 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] Creating offline snapshot 3093081b-d865-4b93-9b55-b4ad406185b0 of volume 49247e00-da21-48b2-8ed7-b0b721db254c {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:02:49 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52cc171-a249-4889-8fe7-c0293ad3d56b]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:49 devstack sudo[109010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c Jul 24 16:02:49 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:49 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c" returned: 0 in 0.351s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:49 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0 1G Jul 24 16:02:49 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:50 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0 1G" returned: 0 in 0.369s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49247e00-da21-48b2-8ed7-b0b721db254c -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:50 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49247e00-da21-48b2-8ed7-b0b721db254c -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0 Jul 24 16:02:50 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:50 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49247e00-da21-48b2-8ed7-b0b721db254c -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0" returned: 0 in 0.279s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:50 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0 is being set with open permissions: ugo+rw Jul 24 16:02:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:50 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0 Jul 24 16:02:50 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:50 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0" returned: 0 in 0.237s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:50 devstack sudo[109028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.info Jul 24 16:02:50 devstack sudo[109028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:51 devstack sudo[109028]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.info" returned: 0 in 0.243s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:51 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.info is being set with open permissions: ugo+rw Jul 24 16:02:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:51 devstack sudo[109032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.info Jul 24 16:02:51 devstack sudo[109032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:51 devstack sudo[109032]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.info" returned: 0 in 0.241s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.797s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:51 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-59311cc8-d6bf-401c-a163-39c34af1395d tempest-ProjectMemberTests-556951607 None] Create snapshot completed successfully Jul 24 16:02:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-3093081b-d865-4b93-9b55-b4ad406185b0-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Lock "cinder-3093081b-d865-4b93-9b55-b4ad406185b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-49247e00-da21-48b2-8ed7-b0b721db254c" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-49247e00-da21-48b2-8ed7-b0b721db254c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-3093081b-d865-4b93-9b55-b4ad406185b0" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-3093081b-d865-4b93-9b55-b4ad406185b0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Deleting offline snapshot 3093081b-d865-4b93-9b55-b4ad406185b0 of volume 49247e00-da21-48b2-8ed7-b0b721db254c {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:02:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] snapshot_file for this snap is: volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:02:51 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6599e5d-b994-487c-983d-46822b6f86a9]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:51 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0 Jul 24 16:02:51 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:52 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0" returned: 0 in 0.340s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:52 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49247e00-da21-48b2-8ed7-b0b721db254c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:02:52 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e2e5a7-46ab-4f5d-8f3d-f7141022bde6]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:52 devstack sudo[109041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c Jul 24 16:02:52 devstack sudo[109041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:52 devstack sudo[109041]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c" returned: 0 in 0.341s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:52 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0 Jul 24 16:02:52 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:52 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0" returned: 0 in 0.325s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:52 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0 Jul 24 16:02:52 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:52 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c.3093081b-d865-4b93-9b55-b4ad406185b0" returned: 0 in 0.242s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-3093081b-d865-4b93-9b55-b4ad406185b0" released by "_delete_snapshot" :: held 1.329s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-49247e00-da21-48b2-8ed7-b0b721db254c" released by "delete_snapshot" :: held 1.351s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:53 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Created reservations ['c5f09e0a-9adb-4468-bfed-ab05f883ba86', 'e6f148d7-2b03-40dd-a312-115eb0374e39', '674b706a-1f51-4f34-879c-774cf71bb7e2', '06eb2231-048a-4bd9-9902-25c0b17b0032'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:53 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Delete snapshot completed successfully. Jul 24 16:02:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ebe4c155-8952-4069-b487-26e28162f486 tempest-ProjectMemberTests-556951607 None] Lock "cinder-3093081b-d865-4b93-9b55-b4ad406185b0-delete_snapshot" released by "delete_snapshot" :: held 1.485s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-49247e00-da21-48b2-8ed7-b0b721db254c-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Lock "cinder-49247e00-da21-48b2-8ed7-b0b721db254c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-49247e00-da21-48b2-8ed7-b0b721db254c" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-49247e00-da21-48b2-8ed7-b0b721db254c" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:53 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[13761941-cd0a-4510-80e7-337e8594ea8f]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:53 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c Jul 24 16:02:53 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:54 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c" returned: 0 in 0.339s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:54 devstack sudo[109059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c Jul 24 16:02:54 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:54 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-49247e00-da21-48b2-8ed7-b0b721db254c" returned: 0 in 0.245s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-49247e00-da21-48b2-8ed7-b0b721db254c" released by "delete_volume" :: held 0.639s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:54 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Created reservations ['994c9729-dd71-442f-af57-aa039302c35b', '1e589c84-db6e-427e-a8a3-7c686cb88f9c', '6ca5529d-928d-465e-9255-2024db94e283', '2d183378-6946-4b61-b3d7-45a47e336b50'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:02:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:54 devstack sudo[109062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:02:54 devstack sudo[109062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:54 devstack sudo[109062]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.238s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:54 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:02:54 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Deleted volume successfully. Jul 24 16:02:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-32a9a4ce-bad9-40af-a1de-8d1df52db131 tempest-ProjectMemberTests-556951607 None] Lock "cinder-49247e00-da21-48b2-8ed7-b0b721db254c-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (135588ec-255d-4c8d-8bb4-874e8e2e6e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4db12f-a6c9-4396-954b-5e93d7c5484c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4db12f-a6c9-4396-954b-5e93d7c5484c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1869755831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b891cc-a102-404f-805e-6c7e868fef59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:02:55Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cd741c-0ea2-4a0d-b23b-91f1f07b1e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cd741c-0ea2-4a0d-b23b-91f1f07b1e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af65346-96d8-4c7a-a2e8-87c729a49c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7af65346-96d8-4c7a-a2e8-87c729a49c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b891cc-a102-404f-805e-6c7e868fef59', 'volume_name': 'volume-34b891cc-a102-404f-805e-6c7e868fef59', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9b60fb-eeca-49d5-9c05-bb7fdd2ec317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9b60fb-eeca-49d5-9c05-bb7fdd2ec317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464c77ba-3f52-4bc6-b6a4-bade166e09e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:55 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Volume 34b891cc-a102-404f-805e-6c7e868fef59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b891cc-a102-404f-805e-6c7e868fef59', 'volume_size': 1} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1869755831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b891cc-a102-404f-805e-6c7e868fef59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:02:55Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Creating volume 34b891cc-a102-404f-805e-6c7e868fef59 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:02:55 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:55 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59 1073741824 Jul 24 16:02:55 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:55 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59 1073741824" returned: 0 in 0.425s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:55 devstack sudo[109070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59 Jul 24 16:02:55 devstack sudo[109070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:56 devstack sudo[109070]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59" returned: 0 in 0.239s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:02:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (464c77ba-3f52-4bc6-b6a4-bade166e09e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b891cc-a102-404f-805e-6c7e868fef59', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93a578c-3a75-43a3-b4e2-6ea19316a3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:02:56 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Volume volume-34b891cc-a102-404f-805e-6c7e868fef59 (34b891cc-a102-404f-805e-6c7e868fef59): created successfully Jul 24 16:02:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93a578c-3a75-43a3-b4e2-6ea19316a3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:02:56 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (135588ec-255d-4c8d-8bb4-874e8e2e6e5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:02:56 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b3f8bf26-cbb1-4460-b1de-d33c5dac5c8a tempest-ProjectMemberTests-556951607 None] Created volume successfully. Jul 24 16:02:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:02:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:02:56 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] Creating offline snapshot f187ad4e-890b-4c49-9bec-1ad6615975c9 of volume 34b891cc-a102-404f-805e-6c7e868fef59 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:02:56 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fd2671-90a2-403d-aaab-51ec93924c3f]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:56 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59 Jul 24 16:02:56 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:56 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59" returned: 0 in 0.363s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:56 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9 1G Jul 24 16:02:56 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:57 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9 1G" returned: 0 in 0.390s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b891cc-a102-404f-805e-6c7e868fef59 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:57 devstack sudo[109084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b891cc-a102-404f-805e-6c7e868fef59 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9 Jul 24 16:02:57 devstack sudo[109084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:57 devstack sudo[109084]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34b891cc-a102-404f-805e-6c7e868fef59 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9" returned: 0 in 0.301s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:57 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9 is being set with open permissions: ugo+rw Jul 24 16:02:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:57 devstack sudo[109089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9 Jul 24 16:02:57 devstack sudo[109089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:57 devstack sudo[109089]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9" returned: 0 in 0.232s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:57 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.info Jul 24 16:02:57 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:58 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.info" returned: 0 in 0.240s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:58 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.info is being set with open permissions: ugo+rw Jul 24 16:02:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:58 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.info Jul 24 16:02:58 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:58 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.info" returned: 0 in 0.237s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:02:58 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-84074b4d-c678-46a0-9912-b47c228f0e77 tempest-ProjectMemberTests-556951607 None] Create snapshot completed successfully Jul 24 16:02:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-f187ad4e-890b-4c49-9bec-1ad6615975c9-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Lock "cinder-f187ad4e-890b-4c49-9bec-1ad6615975c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-34b891cc-a102-404f-805e-6c7e868fef59" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-34b891cc-a102-404f-805e-6c7e868fef59" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-f187ad4e-890b-4c49-9bec-1ad6615975c9" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:02:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-f187ad4e-890b-4c49-9bec-1ad6615975c9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:02:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Deleting offline snapshot f187ad4e-890b-4c49-9bec-1ad6615975c9 of volume 34b891cc-a102-404f-805e-6c7e868fef59 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:02:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] snapshot_file for this snap is: volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:02:58 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6675b49-8d37-46a2-9e66-e58c8e73b6a1]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:58 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9 Jul 24 16:02:58 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:59 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9" returned: 0 in 0.340s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:59 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34b891cc-a102-404f-805e-6c7e868fef59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:02:59 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cacb52-3f3a-4e5d-b784-2d5c796319fe]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:02:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:59 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59 Jul 24 16:02:59 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:59 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59" returned: 0 in 0.341s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:59 devstack sudo[109108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9 Jul 24 16:02:59 devstack sudo[109108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:59 devstack sudo[109108]: pam_unix(sudo:session): session closed for user root Jul 24 16:02:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9" returned: 0 in 0.339s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:02:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:02:59 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9 Jul 24 16:02:59 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:02:59 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59.f187ad4e-890b-4c49-9bec-1ad6615975c9" returned: 0 in 0.240s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-f187ad4e-890b-4c49-9bec-1ad6615975c9" released by "_delete_snapshot" :: held 1.348s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-34b891cc-a102-404f-805e-6c7e868fef59" released by "delete_snapshot" :: held 1.370s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:00 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Created reservations ['8bec4d89-62c0-4755-946b-3f7411121ff0', '54bb31d9-9280-4464-9900-67f96269e1e4', '70da292e-3fba-4dd8-b11f-f5052de9b426', '77014533-9284-4625-90b7-29b79f898b60'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:00 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Delete snapshot completed successfully. Jul 24 16:03:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3cab3645-a927-432f-81d4-bd31aa977ef4 tempest-ProjectMemberTests-556951607 None] Lock "cinder-f187ad4e-890b-4c49-9bec-1ad6615975c9-delete_snapshot" released by "delete_snapshot" :: held 1.498s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-34b891cc-a102-404f-805e-6c7e868fef59-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Lock "cinder-34b891cc-a102-404f-805e-6c7e868fef59-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-34b891cc-a102-404f-805e-6c7e868fef59" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-34b891cc-a102-404f-805e-6c7e868fef59" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:00 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bea5ba-5ef7-4f02-b6cf-0af1ae7f1af0]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:00 devstack sudo[109117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59 Jul 24 16:03:00 devstack sudo[109117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:01 devstack sudo[109117]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59" returned: 0 in 0.348s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:01 devstack sudo[109122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59 Jul 24 16:03:01 devstack sudo[109122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:01 devstack sudo[109122]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-34b891cc-a102-404f-805e-6c7e868fef59" returned: 0 in 0.238s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-34b891cc-a102-404f-805e-6c7e868fef59" released by "delete_volume" :: held 0.642s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:01 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Created reservations ['76d35ff1-b411-49e9-a221-58c6e02cb265', 'b5c231e8-02b7-41b9-ae14-f190f70af70f', '010a0325-458f-4be3-a3a9-eaa03b5c019e', 'c6e240f1-b660-41e0-a76d-0b7f8def2d7d'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:01 devstack sudo[109125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:03:01 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:01 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.231s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:01 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:03:01 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Deleted volume successfully. Jul 24 16:03:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d6885d01-f92b-42fe-ab9f-386614972053 tempest-ProjectMemberTests-556951607 None] Lock "cinder-34b891cc-a102-404f-805e-6c7e868fef59-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (7529d14e-89c7-4221-bdec-0bda7596db89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19765866-c4df-419a-93b3-5f5e1c5a21b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19765866-c4df-419a-93b3-5f5e1c5a21b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337751529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efea6b5-b3b3-4e48-be24-afee3bb1a1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:02Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d38980-d6aa-400b-a02a-83fb8057ed96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d38980-d6aa-400b-a02a-83fb8057ed96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4872241a-5fec-44dc-9daa-75ef841f2729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4872241a-5fec-44dc-9daa-75ef841f2729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8efea6b5-b3b3-4e48-be24-afee3bb1a1d8', 'volume_name': 'volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a50ce9-71f4-4025-8198-2f2010f8e2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a50ce9-71f4-4025-8198-2f2010f8e2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f156572-86a0-4a73-8819-58fc618082ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:02 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Volume 8efea6b5-b3b3-4e48-be24-afee3bb1a1d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8', 'volume_size': 1} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337751529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8efea6b5-b3b3-4e48-be24-afee3bb1a1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:02Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Creating volume 8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:03:02 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:02 devstack sudo[109128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 1073741824 Jul 24 16:03:02 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:02 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 1073741824" returned: 0 in 0.413s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:02 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:02 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 Jul 24 16:03:02 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:03 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8" returned: 0 in 0.241s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:03:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f156572-86a0-4a73-8819-58fc618082ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98ff0ec-722d-4770-b757-96eab59cf78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:03 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Volume volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 (8efea6b5-b3b3-4e48-be24-afee3bb1a1d8): created successfully Jul 24 16:03:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98ff0ec-722d-4770-b757-96eab59cf78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:03 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (7529d14e-89c7-4221-bdec-0bda7596db89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:03 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-2128be2d-6d5f-4bda-b9b2-4f8ce5b6b37e tempest-ProjectMemberTests-556951607 None] Created volume successfully. Jul 24 16:03:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:03 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] Creating offline snapshot e163b605-e7c4-4fdd-b0b5-78687ef30294 of volume 8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:03:03 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[00aff5c2-ee2e-4ca0-a314-f3d4c292baf3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:03 devstack sudo[109137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 Jul 24 16:03:03 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:03 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8" returned: 0 in 0.346s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:03 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:03 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294 1G Jul 24 16:03:03 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:04 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294 1G" returned: 0 in 0.386s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:04 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294 Jul 24 16:03:04 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:04 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294" returned: 0 in 0.283s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:04 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294 is being set with open permissions: ugo+rw Jul 24 16:03:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:04 devstack sudo[109152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294 Jul 24 16:03:04 devstack sudo[109152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:04 devstack sudo[109152]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294" returned: 0 in 0.236s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:04 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:04 devstack sudo[109155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.info Jul 24 16:03:04 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:05 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.info" returned: 0 in 0.244s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:05 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.info is being set with open permissions: ugo+rw Jul 24 16:03:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:05 devstack sudo[109158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.info Jul 24 16:03:05 devstack sudo[109158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:05 devstack sudo[109158]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.info" returned: 0 in 0.233s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.803s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:05 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-6632bb1e-81f7-4825-aab5-491a45a716ee tempest-ProjectMemberTests-556951607 None] Create snapshot completed successfully Jul 24 16:03:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-e163b605-e7c4-4fdd-b0b5-78687ef30294-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Lock "cinder-e163b605-e7c4-4fdd-b0b5-78687ef30294-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-e163b605-e7c4-4fdd-b0b5-78687ef30294" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:05 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-e163b605-e7c4-4fdd-b0b5-78687ef30294" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Deleting offline snapshot e163b605-e7c4-4fdd-b0b5-78687ef30294 of volume 8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:03:05 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] snapshot_file for this snap is: volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:03:05 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a16dda2-a30c-4aaa-8cf0-7f29b0145cd3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:05 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:05 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294 Jul 24 16:03:05 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:06 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294" returned: 0 in 0.351s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:06 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:03:06 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50afde6-5ad8-4014-a77f-5e6ed270a9a8]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:06 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 Jul 24 16:03:06 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:06 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8" returned: 0 in 0.350s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:06 devstack sudo[109171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294 Jul 24 16:03:06 devstack sudo[109171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:06 devstack sudo[109171]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294" returned: 0 in 0.323s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:06 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294 Jul 24 16:03:06 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:06 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:06 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8.e163b605-e7c4-4fdd-b0b5-78687ef30294" returned: 0 in 0.248s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-e163b605-e7c4-4fdd-b0b5-78687ef30294" released by "_delete_snapshot" :: held 1.358s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8" released by "delete_snapshot" :: held 1.378s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:07 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Created reservations ['133f149e-83a0-4e23-86d2-99eeb3688a91', '84d45d55-5c74-492d-a37a-b0f055d931c2', '0f293c49-8bd3-41d6-b65c-0238d3ece538', '37c1800a-a10c-4472-81ae-1ee4c7c7afe6'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:07 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Delete snapshot completed successfully. Jul 24 16:03:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-1b4972db-f17b-43ba-a994-61fcace502e6 tempest-ProjectMemberTests-556951607 None] Lock "cinder-e163b605-e7c4-4fdd-b0b5-78687ef30294-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Lock "cinder-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:07 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:07 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff695c80-15fd-471d-83e8-ddb3103668f4]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:07 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:07 devstack sudo[109179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 Jul 24 16:03:07 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:08 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8" returned: 0 in 0.361s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:08 devstack sudo[109184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8 Jul 24 16:03:08 devstack sudo[109184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:08 devstack sudo[109184]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8" returned: 0 in 0.237s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8" released by "delete_volume" :: held 0.651s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:08 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Created reservations ['86274eb7-1527-46b4-934b-7c271024dd74', '58f0c111-ac40-4906-8d79-cca2031f6e81', '6b749d11-3462-44bd-9a62-2f11f732e0e6', 'f576abb0-2191-4ccf-85fb-a2b03bf72b51'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:08 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:08 devstack sudo[109187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:03:08 devstack sudo[109187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:08 devstack sudo[109187]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:08 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.235s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:08 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:03:08 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Deleted volume successfully. Jul 24 16:03:08 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d899bbf1-ade1-4583-95e2-16216de4b23f tempest-ProjectMemberTests-556951607 None] Lock "cinder-8efea6b5-b3b3-4e48-be24-afee3bb1a1d8-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (e6e7ee11-2927-4636-a854-c6794ec19842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a47d138-b374-4bf7-a370-faa32acdf138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a47d138-b374-4bf7-a370-faa32acdf138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021792845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7fc1095-289d-4b76-92fa-687eb8810f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:09Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85655843-f67a-4f4f-bd9c-b5ba7abaf8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85655843-f67a-4f4f-bd9c-b5ba7abaf8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1d68c0-c61b-4108-887f-dc9466d299f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1d68c0-c61b-4108-887f-dc9466d299f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7fc1095-289d-4b76-92fa-687eb8810f34', 'volume_name': 'volume-f7fc1095-289d-4b76-92fa-687eb8810f34', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d394657b-11da-4b25-ab38-f1e7f4aa1f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d394657b-11da-4b25-ab38-f1e7f4aa1f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995b696c-8053-454e-8cd8-76fb61a25276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:09 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Volume f7fc1095-289d-4b76-92fa-687eb8810f34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7fc1095-289d-4b76-92fa-687eb8810f34', 'volume_size': 1} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2021792845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7fc1095-289d-4b76-92fa-687eb8810f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:09Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Creating volume f7fc1095-289d-4b76-92fa-687eb8810f34 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:03:09 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:09 devstack sudo[109226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34 1073741824 Jul 24 16:03:09 devstack sudo[109226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:09 devstack sudo[109226]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34 1073741824" returned: 0 in 0.416s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:09 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:09 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34 Jul 24 16:03:09 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:10 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34" returned: 0 in 0.238s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:03:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (995b696c-8053-454e-8cd8-76fb61a25276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7fc1095-289d-4b76-92fa-687eb8810f34', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022d8b2a-4157-4fb8-819b-2d3bdc82710d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:10 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Volume volume-f7fc1095-289d-4b76-92fa-687eb8810f34 (f7fc1095-289d-4b76-92fa-687eb8810f34): created successfully Jul 24 16:03:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022d8b2a-4157-4fb8-819b-2d3bdc82710d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:10 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (e6e7ee11-2927-4636-a854-c6794ec19842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:10 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-fb3b42f5-c81c-428d-8899-ac4c8ab37f4b tempest-ProjectMemberTests-556951607 None] Created volume successfully. Jul 24 16:03:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:10 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] Creating offline snapshot 7630d049-a31b-472d-bf9f-9eb0f1ecce2b of volume f7fc1095-289d-4b76-92fa-687eb8810f34 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:03:10 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dda81f5-0fd5-4b19-b25a-73ed86894dbc]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:10 devstack sudo[109234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34 Jul 24 16:03:10 devstack sudo[109234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:10 devstack sudo[109234]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34" returned: 0 in 0.344s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:10 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:10 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b 1G Jul 24 16:03:10 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:11 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b 1G" returned: 0 in 0.371s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7fc1095-289d-4b76-92fa-687eb8810f34 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:11 devstack sudo[109246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7fc1095-289d-4b76-92fa-687eb8810f34 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b Jul 24 16:03:11 devstack sudo[109246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:11 devstack sudo[109246]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7fc1095-289d-4b76-92fa-687eb8810f34 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b" returned: 0 in 0.286s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:11 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b is being set with open permissions: ugo+rw Jul 24 16:03:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:11 devstack sudo[109251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b Jul 24 16:03:11 devstack sudo[109251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:11 devstack sudo[109251]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b" returned: 0 in 0.239s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:11 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:11 devstack sudo[109254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.info Jul 24 16:03:11 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:12 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.info" returned: 0 in 0.239s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:12 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.info is being set with open permissions: ugo+rw Jul 24 16:03:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:12 devstack sudo[109257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.info Jul 24 16:03:12 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:12 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.info" returned: 0 in 0.236s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.789s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:12 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d41e2b0b-5ec0-4b4d-bcfc-8c23ed15f434 tempest-ProjectMemberTests-556951607 None] Create snapshot completed successfully Jul 24 16:03:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-7630d049-a31b-472d-bf9f-9eb0f1ecce2b-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Lock "cinder-7630d049-a31b-472d-bf9f-9eb0f1ecce2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-f7fc1095-289d-4b76-92fa-687eb8810f34" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-f7fc1095-289d-4b76-92fa-687eb8810f34" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-7630d049-a31b-472d-bf9f-9eb0f1ecce2b" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:12 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-7630d049-a31b-472d-bf9f-9eb0f1ecce2b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Deleting offline snapshot 7630d049-a31b-472d-bf9f-9eb0f1ecce2b of volume f7fc1095-289d-4b76-92fa-687eb8810f34 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:03:12 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] snapshot_file for this snap is: volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:03:12 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9f4df5-223d-4b1c-86c5-30fed50dee97]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:12 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:12 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b Jul 24 16:03:12 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:13 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b" returned: 0 in 0.340s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:13 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7fc1095-289d-4b76-92fa-687eb8810f34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:03:13 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1560bd-c3ab-498e-93f6-b6a366561187]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:13 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34 Jul 24 16:03:13 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:13 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34" returned: 0 in 0.348s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:13 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b Jul 24 16:03:13 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:13 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b" returned: 0 in 0.337s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:13 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:13 devstack sudo[109277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b Jul 24 16:03:13 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:14 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34.7630d049-a31b-472d-bf9f-9eb0f1ecce2b" returned: 0 in 0.249s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-7630d049-a31b-472d-bf9f-9eb0f1ecce2b" released by "_delete_snapshot" :: held 1.359s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-f7fc1095-289d-4b76-92fa-687eb8810f34" released by "delete_snapshot" :: held 1.381s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:14 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Created reservations ['9c4a9738-7bfe-4aa2-b091-7d0505bd6964', '41605a46-b9d9-4cf4-a032-a670abe6b417', '24febd93-930a-46bb-b443-eb8a12c1a46d', 'aa2bbf53-5230-40e3-9aea-ae12e51ee6e5'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:14 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Delete snapshot completed successfully. Jul 24 16:03:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-ffe5ec15-a0c0-46b7-ab3a-86427ce9e370 tempest-ProjectMemberTests-556951607 None] Lock "cinder-7630d049-a31b-472d-bf9f-9eb0f1ecce2b-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-f7fc1095-289d-4b76-92fa-687eb8810f34-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Lock "cinder-f7fc1095-289d-4b76-92fa-687eb8810f34-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-f7fc1095-289d-4b76-92fa-687eb8810f34" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:14 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-f7fc1095-289d-4b76-92fa-687eb8810f34" acquired by "delete_volume" :: waited 0.014s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:14 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[225c472e-0449-4e2f-806c-9e97dae92e2c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:14 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:14 devstack sudo[109280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34 Jul 24 16:03:14 devstack sudo[109280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:15 devstack sudo[109280]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34" returned: 0 in 0.347s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:15 devstack sudo[109285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34 Jul 24 16:03:15 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:15 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-f7fc1095-289d-4b76-92fa-687eb8810f34" returned: 0 in 0.244s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:15 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-f7fc1095-289d-4b76-92fa-687eb8810f34" released by "delete_volume" :: held 0.643s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:15 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Created reservations ['eea52e79-54d1-4ff5-bcad-17ce817a1c71', 'b6a7da05-9006-4b9e-ab19-0fe6a6ca768e', 'bd1779fc-bab9-47e6-85e5-79ad468d4f76', '63796196-0bab-46ce-84ad-5631711c84be'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:15 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:15 devstack sudo[109288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:03:15 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:15 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:15 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.245s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:15 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:03:15 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Deleted volume successfully. Jul 24 16:03:15 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-14777c03-15f5-4e16-af16-ccd582ad22f3 tempest-ProjectMemberTests-556951607 None] Lock "cinder-f7fc1095-289d-4b76-92fa-687eb8810f34-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (ea81c795-724b-4a55-977b-b4dd4788d274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c3b987-36c9-45c6-a5f9-ff260f2ef424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7c3b987-36c9-45c6-a5f9-ff260f2ef424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656995501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7285cf7-1abe-4266-a001-a27fca5ecf81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:16Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002995f7-0fe6-4707-ac26-52dbde81d716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (002995f7-0fe6-4707-ac26-52dbde81d716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb5460b-436b-4dcd-8cd2-dcfaaa06d231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb5460b-436b-4dcd-8cd2-dcfaaa06d231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7285cf7-1abe-4266-a001-a27fca5ecf81', 'volume_name': 'volume-c7285cf7-1abe-4266-a001-a27fca5ecf81', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792171c8-e50c-42ee-ab69-f2243480ad10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (792171c8-e50c-42ee-ab69-f2243480ad10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e08c882-3869-432d-9177-d2f61ae0f3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:16 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Volume c7285cf7-1abe-4266-a001-a27fca5ecf81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7285cf7-1abe-4266-a001-a27fca5ecf81', 'volume_size': 1} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1656995501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7285cf7-1abe-4266-a001-a27fca5ecf81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b34222dcff4f5fb0d5a7c423b831b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:16Z,use_quota=True,user_id='388f4e48ca224319ac8b2c783431e60f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Creating volume c7285cf7-1abe-4266-a001-a27fca5ecf81 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:03:16 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:16 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 1073741824 Jul 24 16:03:16 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:16 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 1073741824" returned: 0 in 0.408s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:16 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:16 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 Jul 24 16:03:16 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:17 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81" returned: 0 in 0.250s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:03:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e08c882-3869-432d-9177-d2f61ae0f3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7285cf7-1abe-4266-a001-a27fca5ecf81', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821711ce-75c6-40b4-8898-ba63df4534b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:17 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Volume volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 (c7285cf7-1abe-4266-a001-a27fca5ecf81): created successfully Jul 24 16:03:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821711ce-75c6-40b4-8898-ba63df4534b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:17 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Flow 'volume_create_manager' (ea81c795-724b-4a55-977b-b4dd4788d274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:17 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b00118d4-ceeb-4390-a5d7-955ba01ee31b tempest-ProjectMemberTests-556951607 None] Created volume successfully. Jul 24 16:03:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:17 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] Creating offline snapshot 3b8078cd-131d-4802-91f6-7e46fbd79305 of volume c7285cf7-1abe-4266-a001-a27fca5ecf81 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:03:17 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ebd624-77ce-4628-a764-256f186d719d]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:17 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 Jul 24 16:03:17 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:17 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81" returned: 0 in 0.338s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:17 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:17 devstack sudo[109313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305 1G Jul 24 16:03:17 devstack sudo[109313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:18 devstack sudo[109313]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305 1G" returned: 0 in 0.380s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:18 devstack sudo[109319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305 Jul 24 16:03:18 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:18 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305" returned: 0 in 0.305s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:18 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305 is being set with open permissions: ugo+rw Jul 24 16:03:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:18 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305 Jul 24 16:03:18 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:18 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305" returned: 0 in 0.240s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:18 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:18 devstack sudo[109328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.info Jul 24 16:03:18 devstack sudo[109328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:19 devstack sudo[109328]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.info" returned: 0 in 0.252s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:19 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.info is being set with open permissions: ugo+rw Jul 24 16:03:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:19 devstack sudo[109331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.info Jul 24 16:03:19 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:19 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.info" returned: 0 in 0.240s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:19 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-fc737bd1-dc60-4595-88df-139e8678fc61 tempest-ProjectMemberTests-556951607 None] Create snapshot completed successfully Jul 24 16:03:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-3b8078cd-131d-4802-91f6-7e46fbd79305-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Lock "cinder-3b8078cd-131d-4802-91f6-7e46fbd79305-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-c7285cf7-1abe-4266-a001-a27fca5ecf81" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-c7285cf7-1abe-4266-a001-a27fca5ecf81" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-3b8078cd-131d-4802-91f6-7e46fbd79305" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:19 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-3b8078cd-131d-4802-91f6-7e46fbd79305" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Deleting offline snapshot 3b8078cd-131d-4802-91f6-7e46fbd79305 of volume c7285cf7-1abe-4266-a001-a27fca5ecf81 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:03:19 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] snapshot_file for this snap is: volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:03:19 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9036587-606d-4169-bfa9-976166eff52f]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:19 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:19 devstack sudo[109334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305 Jul 24 16:03:19 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:20 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305" returned: 0 in 0.370s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:20 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7285cf7-1abe-4266-a001-a27fca5ecf81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:03:20 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5755344b-a004-4432-b579-f1354e1b0890]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:20 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 Jul 24 16:03:20 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:20 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81" returned: 0 in 0.374s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:20 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305 Jul 24 16:03:20 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:20 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305" returned: 0 in 0.356s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:20 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:20 devstack sudo[109350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305 Jul 24 16:03:21 devstack sudo[109350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:21 devstack sudo[109350]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:21 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81.3b8078cd-131d-4802-91f6-7e46fbd79305" returned: 0 in 0.270s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-3b8078cd-131d-4802-91f6-7e46fbd79305" released by "_delete_snapshot" :: held 1.460s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-c7285cf7-1abe-4266-a001-a27fca5ecf81" released by "delete_snapshot" :: held 1.485s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:21 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Created reservations ['b594c399-2629-4afb-8e0e-09d1a2f686c0', 'a37ea9c1-fdd4-4d1d-9c63-51050f483404', '393b0fa6-adb4-4c7c-b900-90b5689a6eff', '1186db13-b3de-4a33-9f80-7975961b7db2'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:21 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Delete snapshot completed successfully. Jul 24 16:03:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-56af8967-9ac8-43e5-b7a1-5312122f430d tempest-ProjectMemberTests-556951607 None] Lock "cinder-3b8078cd-131d-4802-91f6-7e46fbd79305-delete_snapshot" released by "delete_snapshot" :: held 1.623s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-c7285cf7-1abe-4266-a001-a27fca5ecf81-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Lock "cinder-c7285cf7-1abe-4266-a001-a27fca5ecf81-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Acquiring lock "cinder-quobyte-c7285cf7-1abe-4266-a001-a27fca5ecf81" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:21 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-c7285cf7-1abe-4266-a001-a27fca5ecf81" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:22 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3a4a09-578a-4e65-bfb9-1e3d7c3c5e87]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:22 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 Jul 24 16:03:22 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:22 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81" returned: 0 in 0.357s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:22 devstack sudo[109358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81 Jul 24 16:03:22 devstack sudo[109358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:22 devstack sudo[109358]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c7285cf7-1abe-4266-a001-a27fca5ecf81" returned: 0 in 0.249s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:22 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Lock "cinder-quobyte-c7285cf7-1abe-4266-a001-a27fca5ecf81" released by "delete_volume" :: held 0.660s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:22 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Created reservations ['adef0e34-e578-4e94-b1a9-294786459e2c', 'a1663808-5c95-4452-83d2-8ad34f07ceb4', '64ae67f0-4f7a-4db2-b179-cd382a1dd262', '0585394e-6f02-4a13-bc92-e3d5bda1dc16'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:22 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:22 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:22 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:03:22 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:23 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:23 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.249s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:23 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:03:23 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Deleted volume successfully. Jul 24 16:03:23 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-66b0271e-4e3f-4c38-9115-33e98f5f55f3 tempest-ProjectMemberTests-556951607 None] Lock "cinder-c7285cf7-1abe-4266-a001-a27fca5ecf81-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Flow 'volume_create_manager' (40c26da0-9601-4e7c-8e06-3e4514c5e28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f08cff-5c51-4acb-853f-75fcba407e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f08cff-5c51-4acb-853f-75fcba407e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653395243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7718709-4792-4c49-a8a3-91f42c613a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c086f94f64414f4fa8092822a044db34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:27Z,use_quota=True,user_id='40a5263a3e2d4245a00f106cd6fdaa7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc929a5-0ec9-4bfb-9c86-096b7d053a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc929a5-0ec9-4bfb-9c86-096b7d053a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97ed520-624a-4049-8576-14eef016cc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a97ed520-624a-4049-8576-14eef016cc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7718709-4792-4c49-a8a3-91f42c613a5d', 'volume_name': 'volume-d7718709-4792-4c49-a8a3-91f42c613a5d', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613305c4-a5e2-4aa6-be98-990299fb1a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613305c4-a5e2-4aa6-be98-990299fb1a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa001a2-c582-4279-b450-98c589cfd39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:26 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Volume d7718709-4792-4c49-a8a3-91f42c613a5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7718709-4792-4c49-a8a3-91f42c613a5d', 'volume_size': 1} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653395243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7718709-4792-4c49-a8a3-91f42c613a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c086f94f64414f4fa8092822a044db34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:27Z,use_quota=True,user_id='40a5263a3e2d4245a00f106cd6fdaa7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Creating volume d7718709-4792-4c49-a8a3-91f42c613a5d {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:03:26 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:03:26 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:26 devstack sudo[109365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d 1073741824 Jul 24 16:03:26 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:27 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d 1073741824" returned: 0 in 0.398s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:27 devstack sudo[109371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d Jul 24 16:03:27 devstack sudo[109371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:27 devstack sudo[109371]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d" returned: 0 in 0.251s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:03:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1aa001a2-c582-4279-b450-98c589cfd39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7718709-4792-4c49-a8a3-91f42c613a5d', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a65a79-72be-47fb-af78-d1d7546639ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:27 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Volume volume-d7718709-4792-4c49-a8a3-91f42c613a5d (d7718709-4792-4c49-a8a3-91f42c613a5d): created successfully Jul 24 16:03:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80a65a79-72be-47fb-af78-d1d7546639ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:27 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Flow 'volume_create_manager' (40c26da0-9601-4e7c-8e06-3e4514c5e28e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:27 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b4794d3c-f201-483a-91a6-8ce451f726e5 tempest-ProjectReaderTests-228043090 None] Created volume successfully. Jul 24 16:03:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:27 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] Creating offline snapshot 4b7b0bd3-cc6a-4680-93f6-906da0a08e41 of volume d7718709-4792-4c49-a8a3-91f42c613a5d {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:03:27 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d58e55e-9c73-44cc-a958-b969af317ea3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:27 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:27 devstack sudo[109374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d Jul 24 16:03:27 devstack sudo[109374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:28 devstack sudo[109374]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d" returned: 0 in 0.347s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:28 devstack sudo[109379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41 1G Jul 24 16:03:28 devstack sudo[109379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:28 devstack sudo[109379]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41 1G" returned: 0 in 0.374s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7718709-4792-4c49-a8a3-91f42c613a5d -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:28 devstack sudo[109384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7718709-4792-4c49-a8a3-91f42c613a5d -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41 Jul 24 16:03:28 devstack sudo[109384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:28 devstack sudo[109384]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7718709-4792-4c49-a8a3-91f42c613a5d -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41" returned: 0 in 0.292s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:28 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41 is being set with open permissions: ugo+rw Jul 24 16:03:28 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:28 devstack sudo[109389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41 Jul 24 16:03:28 devstack sudo[109389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:29 devstack sudo[109389]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41" returned: 0 in 0.241s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:29 devstack sudo[109392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.info Jul 24 16:03:29 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:29 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.info" returned: 0 in 0.247s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:29 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.info is being set with open permissions: ugo+rw Jul 24 16:03:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:29 devstack sudo[109395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.info Jul 24 16:03:29 devstack sudo[109395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:29 devstack sudo[109395]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.info" returned: 0 in 0.246s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:29 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:29 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-c3e824b6-386e-4017-bb36-a0992f1a2843 tempest-ProjectReaderTests-228043090 None] Create snapshot completed successfully Jul 24 16:03:29 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-4b7b0bd3-cc6a-4680-93f6-906da0a08e41-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:29 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Lock "cinder-4b7b0bd3-cc6a-4680-93f6-906da0a08e41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:29 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-quobyte-d7718709-4792-4c49-a8a3-91f42c613a5d" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-d7718709-4792-4c49-a8a3-91f42c613a5d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-quobyte-4b7b0bd3-cc6a-4680-93f6-906da0a08e41" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:30 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-4b7b0bd3-cc6a-4680-93f6-906da0a08e41" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Deleting offline snapshot 4b7b0bd3-cc6a-4680-93f6-906da0a08e41 of volume d7718709-4792-4c49-a8a3-91f42c613a5d {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:03:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] snapshot_file for this snap is: volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:03:30 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c31b16-6b9e-48cc-9556-f12de46fda20]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:30 devstack sudo[109398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41 Jul 24 16:03:30 devstack sudo[109398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:30 devstack sudo[109398]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41" returned: 0 in 0.352s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:30 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7718709-4792-4c49-a8a3-91f42c613a5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:03:30 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3d77d2-4e7c-413d-b2a1-a4632fa9d598]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:30 devstack sudo[109403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d Jul 24 16:03:30 devstack sudo[109403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:30 devstack sudo[109403]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d" returned: 0 in 0.346s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:30 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:30 devstack sudo[109408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41 Jul 24 16:03:30 devstack sudo[109408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:31 devstack sudo[109408]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41" returned: 0 in 0.334s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:31 devstack sudo[109414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41 Jul 24 16:03:31 devstack sudo[109414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:31 devstack sudo[109414]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:31 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d.4b7b0bd3-cc6a-4680-93f6-906da0a08e41" returned: 0 in 0.253s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-4b7b0bd3-cc6a-4680-93f6-906da0a08e41" released by "_delete_snapshot" :: held 1.370s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-d7718709-4792-4c49-a8a3-91f42c613a5d" released by "delete_snapshot" :: held 1.393s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:31 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Created reservations ['a0382d15-c919-4281-8a86-7c821e7ccfb8', '01a0e8d8-947b-4193-a7b7-94c13e769633', '3f9d5c01-d9d1-4d15-80cf-f70601aa420c', '19d05ad9-3da0-4065-8464-58f3497f6684'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:31 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Delete snapshot completed successfully. Jul 24 16:03:31 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-b83cc348-af88-4148-94ab-f7218afc0435 tempest-ProjectReaderTests-228043090 None] Lock "cinder-4b7b0bd3-cc6a-4680-93f6-906da0a08e41-delete_snapshot" released by "delete_snapshot" :: held 1.519s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-d7718709-4792-4c49-a8a3-91f42c613a5d-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Lock "cinder-d7718709-4792-4c49-a8a3-91f42c613a5d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-quobyte-d7718709-4792-4c49-a8a3-91f42c613a5d" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-d7718709-4792-4c49-a8a3-91f42c613a5d" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a527bca-b913-4104-beb6-d46ba5b1ac3f]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:32 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d Jul 24 16:03:32 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:32 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d" returned: 0 in 0.357s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:32 devstack sudo[109422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d Jul 24 16:03:32 devstack sudo[109422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:32 devstack sudo[109422]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-d7718709-4792-4c49-a8a3-91f42c613a5d" returned: 0 in 0.253s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-d7718709-4792-4c49-a8a3-91f42c613a5d" released by "delete_volume" :: held 0.662s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Created reservations ['1fb59fd8-46d9-40f3-aa79-699130064f44', '93fc507b-2e9d-45cf-a519-d4ebe993db07', '4532557c-0708-4694-b72c-458d033b6005', 'a4edb669-5983-45a1-89ed-b7b7a3ba6220'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:32 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:32 devstack sudo[109425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:03:32 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:33 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.256s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:03:33 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Deleted volume successfully. Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-f710f27a-a7eb-4cb9-aa2b-c9fc2e9079bc tempest-ProjectReaderTests-228043090 None] Lock "cinder-d7718709-4792-4c49-a8a3-91f42c613a5d-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Flow 'volume_create_manager' (3263f525-b0d9-4597-9ca8-2df841872771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ce35fd-1ee7-4337-aa67-ff84de3c6e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4ce35fd-1ee7-4337-aa67-ff84de3c6e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1130572383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf764842-4da1-4c2f-86d4-761984a6f357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c086f94f64414f4fa8092822a044db34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:34Z,use_quota=True,user_id='40a5263a3e2d4245a00f106cd6fdaa7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb06a0c7-23f1-48be-b65c-9e86f81b7c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb06a0c7-23f1-48be-b65c-9e86f81b7c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ec6cbc-d99d-4086-ad91-773cbad348bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ec6cbc-d99d-4086-ad91-773cbad348bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf764842-4da1-4c2f-86d4-761984a6f357', 'volume_name': 'volume-cf764842-4da1-4c2f-86d4-761984a6f357', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05540411-870b-44b1-bb61-8793bc760d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05540411-870b-44b1-bb61-8793bc760d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f14e28a-fe13-43ec-8be9-ccd9a14724d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:33 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Volume cf764842-4da1-4c2f-86d4-761984a6f357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf764842-4da1-4c2f-86d4-761984a6f357', 'volume_size': 1} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1130572383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf764842-4da1-4c2f-86d4-761984a6f357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c086f94f64414f4fa8092822a044db34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:34Z,use_quota=True,user_id='40a5263a3e2d4245a00f106cd6fdaa7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Creating volume cf764842-4da1-4c2f-86d4-761984a6f357 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:03:33 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:03:33 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:33 devstack sudo[109428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357 1073741824 Jul 24 16:03:33 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:34 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357 1073741824" returned: 0 in 0.392s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:34 devstack sudo[109433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357 Jul 24 16:03:34 devstack sudo[109433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:34 devstack sudo[109433]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357" returned: 0 in 0.236s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:03:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f14e28a-fe13-43ec-8be9-ccd9a14724d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf764842-4da1-4c2f-86d4-761984a6f357', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f4999a-9c71-4d7e-8766-6c7458f2aa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:34 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Volume volume-cf764842-4da1-4c2f-86d4-761984a6f357 (cf764842-4da1-4c2f-86d4-761984a6f357): created successfully Jul 24 16:03:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f4999a-9c71-4d7e-8766-6c7458f2aa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:34 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Flow 'volume_create_manager' (3263f525-b0d9-4597-9ca8-2df841872771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:34 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-5e5d9635-5595-4cec-8cbc-af4fd75d5b02 tempest-ProjectReaderTests-228043090 None] Created volume successfully. Jul 24 16:03:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:34 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] Creating offline snapshot cc1210d1-2157-4af3-94c7-7cf4f535a825 of volume cf764842-4da1-4c2f-86d4-761984a6f357 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:03:34 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07cee74-62ae-46fd-90ea-f5bf618832c8]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:34 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:34 devstack sudo[109436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357 Jul 24 16:03:34 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:35 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357" returned: 0 in 0.343s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:35 devstack sudo[109441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825 1G Jul 24 16:03:35 devstack sudo[109441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:35 devstack sudo[109441]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825 1G" returned: 0 in 0.382s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf764842-4da1-4c2f-86d4-761984a6f357 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:35 devstack sudo[109447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf764842-4da1-4c2f-86d4-761984a6f357 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825 Jul 24 16:03:35 devstack sudo[109447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:35 devstack sudo[109447]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf764842-4da1-4c2f-86d4-761984a6f357 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825" returned: 0 in 0.285s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:35 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825 is being set with open permissions: ugo+rw Jul 24 16:03:35 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:35 devstack sudo[109452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825 Jul 24 16:03:35 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:36 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825" returned: 0 in 0.235s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:36 devstack sudo[109455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.info Jul 24 16:03:36 devstack sudo[109455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:36 devstack sudo[109455]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.info" returned: 0 in 0.244s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:36 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.info is being set with open permissions: ugo+rw Jul 24 16:03:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:36 devstack sudo[109458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.info Jul 24 16:03:36 devstack sudo[109458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:36 devstack sudo[109458]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.info" returned: 0 in 0.250s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:36 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.816s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:36 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-933744e1-3404-44bc-8134-ef59450e36f1 tempest-ProjectReaderTests-228043090 None] Create snapshot completed successfully Jul 24 16:03:36 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-cc1210d1-2157-4af3-94c7-7cf4f535a825-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:36 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Lock "cinder-cc1210d1-2157-4af3-94c7-7cf4f535a825-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:36 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-quobyte-cf764842-4da1-4c2f-86d4-761984a6f357" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-cf764842-4da1-4c2f-86d4-761984a6f357" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-quobyte-cc1210d1-2157-4af3-94c7-7cf4f535a825" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:37 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-cc1210d1-2157-4af3-94c7-7cf4f535a825" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Deleting offline snapshot cc1210d1-2157-4af3-94c7-7cf4f535a825 of volume cf764842-4da1-4c2f-86d4-761984a6f357 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:03:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] snapshot_file for this snap is: volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:03:37 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a875ef-5536-4004-b83d-bd7d8e92318e]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:37 devstack sudo[109461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825 Jul 24 16:03:37 devstack sudo[109461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:37 devstack sudo[109461]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825" returned: 0 in 0.348s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:37 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf764842-4da1-4c2f-86d4-761984a6f357(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:03:37 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b1e0ae-a6ce-4963-b42e-17d288950664]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:37 devstack sudo[109466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357 Jul 24 16:03:37 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:37 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357" returned: 0 in 0.350s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:37 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:37 devstack sudo[109471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825 Jul 24 16:03:37 devstack sudo[109471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:38 devstack sudo[109471]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825" returned: 0 in 0.313s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:38 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825 Jul 24 16:03:38 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:38 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:38 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357.cc1210d1-2157-4af3-94c7-7cf4f535a825" returned: 0 in 0.236s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:38 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-cc1210d1-2157-4af3-94c7-7cf4f535a825" released by "_delete_snapshot" :: held 1.335s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:38 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-cf764842-4da1-4c2f-86d4-761984a6f357" released by "delete_snapshot" :: held 1.356s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:38 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Created reservations ['dba6bc78-27ec-4c37-a104-fb63744bcf18', '869f1d04-200c-434b-ab4a-2e588663851f', 'db8747bb-53dd-44c7-aace-e3f02e56ff70', 'e55d9630-2c01-463c-a4a0-a8e28003eea8'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:38 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Delete snapshot completed successfully. Jul 24 16:03:38 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-be60b542-d263-4f61-846b-2712d59df691 tempest-ProjectReaderTests-228043090 None] Lock "cinder-cc1210d1-2157-4af3-94c7-7cf4f535a825-delete_snapshot" released by "delete_snapshot" :: held 1.482s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-cf764842-4da1-4c2f-86d4-761984a6f357-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Lock "cinder-cf764842-4da1-4c2f-86d4-761984a6f357-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-quobyte-cf764842-4da1-4c2f-86d4-761984a6f357" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-cf764842-4da1-4c2f-86d4-761984a6f357" acquired by "delete_volume" :: waited 0.013s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f96a1c-43a0-4027-bd36-fdfcd2c16357]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:39 devstack sudo[109479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357 Jul 24 16:03:39 devstack sudo[109479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:39 devstack sudo[109479]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357" returned: 0 in 0.350s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:39 devstack sudo[109484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357 Jul 24 16:03:39 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:39 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-cf764842-4da1-4c2f-86d4-761984a6f357" returned: 0 in 0.235s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-cf764842-4da1-4c2f-86d4-761984a6f357" released by "delete_volume" :: held 0.639s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Created reservations ['a186bdfc-5f82-43bc-8424-90f56ec30527', '175e50fa-db92-43a5-9bcb-284ef5de016e', '89415933-c0a5-4952-ad5a-b487dc99af17', 'd7bb60b2-0478-4664-abef-cd3e34a51dc1'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:39 devstack sudo[109487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:03:39 devstack sudo[109487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:39 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:40 devstack sudo[109489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:03:40 devstack sudo[109489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:40 devstack sudo[109487]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.237s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:03:40 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Deleted volume successfully. Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-354f12fa-885a-4d5f-b6a9-1f8e51d27271 tempest-ProjectReaderTests-228043090 None] Lock "cinder-cf764842-4da1-4c2f-86d4-761984a6f357-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:40 devstack sudo[109489]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.251s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG oslo_service.periodic_task [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] Running periodic task VolumeManager._thread_info {{(pid=88350) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread count: 28 {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-44b50fac-4c50-4815-ab70-66497e505057 None None] thread info: [<_MainThread(MainThread, started 138382554529920)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88350) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Flow 'volume_create_manager' (47993b30-d1a8-47b3-95f8-1ebb97d57d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4cf7b0-f55b-4e1d-b361-1d59d73b82f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4cf7b0-f55b-4e1d-b361-1d59d73b82f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677362712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20c6258-1d94-41f7-b140-c5a6858ab6dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c086f94f64414f4fa8092822a044db34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:41Z,use_quota=True,user_id='40a5263a3e2d4245a00f106cd6fdaa7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab222d3-07bd-4f12-99f6-a997247fc778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bab222d3-07bd-4f12-99f6-a997247fc778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0b9c69-32cf-4649-8dea-3e274ff55aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0b9c69-32cf-4649-8dea-3e274ff55aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c20c6258-1d94-41f7-b140-c5a6858ab6dc', 'volume_name': 'volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deef3d4a-df2a-47af-acb9-be6070b6fc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deef3d4a-df2a-47af-acb9-be6070b6fc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca458ca-6039-4256-abd3-dfaa9153ac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:40 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Volume c20c6258-1d94-41f7-b140-c5a6858ab6dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc', 'volume_size': 1} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-677362712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20c6258-1d94-41f7-b140-c5a6858ab6dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c086f94f64414f4fa8092822a044db34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:41Z,use_quota=True,user_id='40a5263a3e2d4245a00f106cd6fdaa7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Creating volume c20c6258-1d94-41f7-b140-c5a6858ab6dc {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:03:40 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:03:40 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:40 devstack sudo[109493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc 1073741824 Jul 24 16:03:40 devstack sudo[109493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:41 devstack sudo[109493]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc 1073741824" returned: 0 in 0.406s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:41 devstack sudo[109499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc Jul 24 16:03:41 devstack sudo[109499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:41 devstack sudo[109499]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc" returned: 0 in 0.242s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:03:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ca458ca-6039-4256-abd3-dfaa9153ac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23888d3-19c7-4208-aed1-ec8f552fe136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:41 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Volume volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc (c20c6258-1d94-41f7-b140-c5a6858ab6dc): created successfully Jul 24 16:03:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c23888d3-19c7-4208-aed1-ec8f552fe136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:41 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Flow 'volume_create_manager' (47993b30-d1a8-47b3-95f8-1ebb97d57d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:41 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e96fa4fa-428d-4b21-8043-6ac643143db0 tempest-ProjectReaderTests-228043090 None] Created volume successfully. Jul 24 16:03:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:41 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] Creating offline snapshot 7c66650d-49a1-46b3-ba39-94022d5a55fa of volume c20c6258-1d94-41f7-b140-c5a6858ab6dc {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:03:41 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51cd4fe-5773-424c-808b-85efdb8b75fa]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:41 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:41 devstack sudo[109502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc Jul 24 16:03:41 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:42 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc" returned: 0 in 0.342s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:42 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa 1G Jul 24 16:03:42 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:42 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa 1G" returned: 0 in 0.385s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:42 devstack sudo[109512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa Jul 24 16:03:42 devstack sudo[109512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:42 devstack sudo[109512]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa" returned: 0 in 0.288s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:42 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa is being set with open permissions: ugo+rw Jul 24 16:03:42 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:42 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa Jul 24 16:03:42 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:43 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa" returned: 0 in 0.240s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:43 devstack sudo[109520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.info Jul 24 16:03:43 devstack sudo[109520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:43 devstack sudo[109520]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.info" returned: 0 in 0.246s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:43 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.info is being set with open permissions: ugo+rw Jul 24 16:03:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:43 devstack sudo[109523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.info Jul 24 16:03:43 devstack sudo[109523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:43 devstack sudo[109523]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.info" returned: 0 in 0.233s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:43 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.810s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:43 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-6e9098d9-3751-4a8e-b310-eceba36a5319 tempest-ProjectReaderTests-228043090 None] Create snapshot completed successfully Jul 24 16:03:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-7c66650d-49a1-46b3-ba39-94022d5a55fa-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Lock "cinder-7c66650d-49a1-46b3-ba39-94022d5a55fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:43 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-quobyte-c20c6258-1d94-41f7-b140-c5a6858ab6dc" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-c20c6258-1d94-41f7-b140-c5a6858ab6dc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-quobyte-7c66650d-49a1-46b3-ba39-94022d5a55fa" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:44 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-7c66650d-49a1-46b3-ba39-94022d5a55fa" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Deleting offline snapshot 7c66650d-49a1-46b3-ba39-94022d5a55fa of volume c20c6258-1d94-41f7-b140-c5a6858ab6dc {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:03:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] snapshot_file for this snap is: volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:03:44 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cee0b7-c6e1-4a90-85e5-b2b3351d70f5]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:44 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa Jul 24 16:03:44 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:44 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa" returned: 0 in 0.350s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:44 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:03:44 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1724e5a-01d7-499a-b482-b5da0089ade5]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:44 devstack sudo[109531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc Jul 24 16:03:44 devstack sudo[109531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:44 devstack sudo[109531]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc" returned: 0 in 0.342s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:44 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:44 devstack sudo[109536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa Jul 24 16:03:44 devstack sudo[109536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:45 devstack sudo[109536]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa" returned: 0 in 0.325s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:45 devstack sudo[109541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa Jul 24 16:03:45 devstack sudo[109541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:45 devstack sudo[109541]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:45 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc.7c66650d-49a1-46b3-ba39-94022d5a55fa" returned: 0 in 0.240s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-7c66650d-49a1-46b3-ba39-94022d5a55fa" released by "_delete_snapshot" :: held 1.347s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-c20c6258-1d94-41f7-b140-c5a6858ab6dc" released by "delete_snapshot" :: held 1.368s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:45 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Created reservations ['23e3cd2b-142d-41f6-b13b-3d147dc751e4', 'fda95b2b-72dd-4113-ba54-10cfb864caa0', '94d997be-a88a-493b-9339-156c77d8dfe9', 'f4e4e9da-a4e5-436c-afbb-00cd71f90a2b'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:45 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Delete snapshot completed successfully. Jul 24 16:03:45 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-d43caaf0-d40a-44dc-9d42-89fa35780c04 tempest-ProjectReaderTests-228043090 None] Lock "cinder-7c66650d-49a1-46b3-ba39-94022d5a55fa-delete_snapshot" released by "delete_snapshot" :: held 1.486s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-c20c6258-1d94-41f7-b140-c5a6858ab6dc-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Lock "cinder-c20c6258-1d94-41f7-b140-c5a6858ab6dc-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-quobyte-c20c6258-1d94-41f7-b140-c5a6858ab6dc" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-c20c6258-1d94-41f7-b140-c5a6858ab6dc" acquired by "delete_volume" :: waited 0.014s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[5152fee7-b07f-4296-87ca-b816e665f7e3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:46 devstack sudo[109544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc Jul 24 16:03:46 devstack sudo[109544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:46 devstack sudo[109544]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc" returned: 0 in 0.352s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:46 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc Jul 24 16:03:46 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:46 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-c20c6258-1d94-41f7-b140-c5a6858ab6dc" returned: 0 in 0.246s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-c20c6258-1d94-41f7-b140-c5a6858ab6dc" released by "delete_volume" :: held 0.657s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=119,cinder:INSERT=39,cinder:UPDATE=145,cinder:DELETE=11 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Created reservations ['53bc529f-8021-4c0e-8e36-f9db7e95c44e', 'dfc12a92-9182-43ab-bfac-4438e4baad43', '3e74ed48-0e31-4dcb-ba22-4becf5f4aa79', '20c497a8-32a4-4115-8b63-065f63e6572b'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:46 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:46 devstack sudo[109553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:03:46 devstack sudo[109553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:47 devstack sudo[109553]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.236s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:03:47 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Deleted volume successfully. Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-e1071eb5-62c7-4a61-9b93-48f97f3e9cff tempest-ProjectReaderTests-228043090 None] Lock "cinder-c20c6258-1d94-41f7-b140-c5a6858ab6dc-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:INSERT=45,cinder:UPDATE=151,cinder:SELECT=113,cinder:DELETE=14 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Flow 'volume_create_manager' (a7572020-fcec-4ace-9f74-f35d779cfb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a33e1f-2c46-4169-922c-4927db0dada1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a33e1f-2c46-4169-922c-4927db0dada1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-184103832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7daf9ebc-027c-4bce-a112-66af8809410e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c086f94f64414f4fa8092822a044db34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:48Z,use_quota=True,user_id='40a5263a3e2d4245a00f106cd6fdaa7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e81deeb-7167-4ac9-b880-3cd539c9a293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e81deeb-7167-4ac9-b880-3cd539c9a293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680d239e-3bc0-4533-af73-273b36895862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680d239e-3bc0-4533-af73-273b36895862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7daf9ebc-027c-4bce-a112-66af8809410e', 'volume_name': 'volume-7daf9ebc-027c-4bce-a112-66af8809410e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22977888-ccec-42f7-ab2c-08dc8d6df4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22977888-ccec-42f7-ab2c-08dc8d6df4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3831d5b-00d1-40c8-a8ed-cf065413cddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:47 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Volume 7daf9ebc-027c-4bce-a112-66af8809410e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7daf9ebc-027c-4bce-a112-66af8809410e', 'volume_size': 1} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-184103832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7daf9ebc-027c-4bce-a112-66af8809410e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c086f94f64414f4fa8092822a044db34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:48Z,use_quota=True,user_id='40a5263a3e2d4245a00f106cd6fdaa7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Creating volume 7daf9ebc-027c-4bce-a112-66af8809410e {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:03:47 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:03:47 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:47 devstack sudo[109556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e 1073741824 Jul 24 16:03:47 devstack sudo[109556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:48 devstack sudo[109556]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e 1073741824" returned: 0 in 0.396s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:48 devstack sudo[109561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e Jul 24 16:03:48 devstack sudo[109561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:48 devstack sudo[109561]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e" returned: 0 in 0.239s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:03:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3831d5b-00d1-40c8-a8ed-cf065413cddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7daf9ebc-027c-4bce-a112-66af8809410e', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41eb5217-93ca-483e-90dd-3a319f51f579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:48 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Volume volume-7daf9ebc-027c-4bce-a112-66af8809410e (7daf9ebc-027c-4bce-a112-66af8809410e): created successfully Jul 24 16:03:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41eb5217-93ca-483e-90dd-3a319f51f579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:48 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Flow 'volume_create_manager' (a7572020-fcec-4ace-9f74-f35d779cfb09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:48 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-a2c11333-768b-420b-a401-87d90cf2ced6 tempest-ProjectReaderTests-228043090 None] Created volume successfully. Jul 24 16:03:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:48 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] Creating offline snapshot b42720b4-2bde-43af-abb6-2342d5b7df7c of volume 7daf9ebc-027c-4bce-a112-66af8809410e {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:03:48 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac633f85-db32-4a41-8cc9-b42868dc27b5]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:48 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:49 devstack sudo[109565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e Jul 24 16:03:49 devstack sudo[109565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:49 devstack sudo[109565]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e" returned: 0 in 0.360s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:49 devstack sudo[109570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c 1G Jul 24 16:03:49 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:49 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c 1G" returned: 0 in 0.388s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7daf9ebc-027c-4bce-a112-66af8809410e -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:49 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7daf9ebc-027c-4bce-a112-66af8809410e -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c Jul 24 16:03:49 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:49 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7daf9ebc-027c-4bce-a112-66af8809410e -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c" returned: 0 in 0.289s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:49 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c is being set with open permissions: ugo+rw Jul 24 16:03:49 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:49 devstack sudo[109580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c Jul 24 16:03:49 devstack sudo[109580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:50 devstack sudo[109580]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c" returned: 0 in 0.238s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:50 devstack sudo[109583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.info Jul 24 16:03:50 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:50 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.info" returned: 0 in 0.237s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:50 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.info is being set with open permissions: ugo+rw Jul 24 16:03:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:50 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.info Jul 24 16:03:50 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:50 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.info" returned: 0 in 0.231s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:50 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.821s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:50 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3adb5b24-fc0f-450b-8ab3-74c538be2a78 tempest-ProjectReaderTests-228043090 None] Create snapshot completed successfully Jul 24 16:03:50 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-b42720b4-2bde-43af-abb6-2342d5b7df7c-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Lock "cinder-b42720b4-2bde-43af-abb6-2342d5b7df7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-quobyte-7daf9ebc-027c-4bce-a112-66af8809410e" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-7daf9ebc-027c-4bce-a112-66af8809410e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-quobyte-b42720b4-2bde-43af-abb6-2342d5b7df7c" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:51 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-b42720b4-2bde-43af-abb6-2342d5b7df7c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Deleting offline snapshot b42720b4-2bde-43af-abb6-2342d5b7df7c of volume 7daf9ebc-027c-4bce-a112-66af8809410e {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:03:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] snapshot_file for this snap is: volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:03:51 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7fa32f-ddbd-4d90-b028-1a9d191622c3]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:51 devstack sudo[109590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c Jul 24 16:03:51 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:51 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c" returned: 0 in 0.356s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:51 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7daf9ebc-027c-4bce-a112-66af8809410e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:03:51 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0416c50-7c19-4f24-a953-7f2955b2408c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:51 devstack sudo[109595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e Jul 24 16:03:51 devstack sudo[109595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:51 devstack sudo[109595]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e" returned: 0 in 0.364s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:51 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:51 devstack sudo[109600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c Jul 24 16:03:51 devstack sudo[109600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:52 devstack sudo[109600]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c" returned: 0 in 0.324s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:52 devstack sudo[109605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c Jul 24 16:03:52 devstack sudo[109605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:52 devstack sudo[109605]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:52 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e.b42720b4-2bde-43af-abb6-2342d5b7df7c" returned: 0 in 0.243s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-b42720b4-2bde-43af-abb6-2342d5b7df7c" released by "_delete_snapshot" :: held 1.376s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-7daf9ebc-027c-4bce-a112-66af8809410e" released by "delete_snapshot" :: held 1.396s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:52 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Created reservations ['cb9429f5-c2ff-4802-8a8a-c13f700a430c', '8495a871-e6a3-4e47-826e-7819e981e6c5', '86614988-fb56-4dee-9b1c-0b78f0369f00', 'ba12bab7-4a47-4450-9af7-c4aedc726c44'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:52 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Delete snapshot completed successfully. Jul 24 16:03:52 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-688c49b8-00c0-40fe-8de1-9b4f2657037b tempest-ProjectReaderTests-228043090 None] Lock "cinder-b42720b4-2bde-43af-abb6-2342d5b7df7c-delete_snapshot" released by "delete_snapshot" :: held 1.527s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-7daf9ebc-027c-4bce-a112-66af8809410e-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Lock "cinder-7daf9ebc-027c-4bce-a112-66af8809410e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-quobyte-7daf9ebc-027c-4bce-a112-66af8809410e" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-7daf9ebc-027c-4bce-a112-66af8809410e" acquired by "delete_volume" :: waited 0.019s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d1d6fe-28fc-42bd-9c00-9847c627c65c]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:53 devstack sudo[109608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e Jul 24 16:03:53 devstack sudo[109608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:53 devstack sudo[109608]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e" returned: 0 in 0.359s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:53 devstack sudo[109613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e Jul 24 16:03:53 devstack sudo[109613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:53 devstack sudo[109613]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-7daf9ebc-027c-4bce-a112-66af8809410e" returned: 0 in 0.234s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-7daf9ebc-027c-4bce-a112-66af8809410e" released by "delete_volume" :: held 0.652s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Created reservations ['5c599274-2b11-44ac-836e-cab62e0adde9', '4e1e331c-a3ad-4449-8433-2bd0b493fe71', '7b9a7370-47c9-477f-ad3b-e51a7928df19', '555be328-3600-49de-b58a-2e71c2938c9d'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:53 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:53 devstack sudo[109616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:03:53 devstack sudo[109616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:54 devstack sudo[109616]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.234s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:03:54 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Deleted volume successfully. Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-488ca724-5e53-4094-a4af-0980c369e38f tempest-ProjectReaderTests-228043090 None] Lock "cinder-7daf9ebc-027c-4bce-a112-66af8809410e-delete_volume" released by "delete_volume" :: held 1.078s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.flows.manager.create_volume [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88350) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Flow 'volume_create_manager' (7069b1a9-3e6b-4310-aaaf-bec6d58f06d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1ce6b9-153d-426c-b418-846c0af0609e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1ce6b9-153d-426c-b418-846c0af0609e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793745358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395c4522-ab61-474b-9a8c-c20173625a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c086f94f64414f4fa8092822a044db34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:55Z,use_quota=True,user_id='40a5263a3e2d4245a00f106cd6fdaa7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b4c26d-60ce-4736-a394-8a5dc3c5fb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b4c26d-60ce-4736-a394-8a5dc3c5fb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475325ef-74a0-4e70-ae65-19cccfefab86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475325ef-74a0-4e70-ae65-19cccfefab86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '395c4522-ab61-474b-9a8c-c20173625a18', 'volume_name': 'volume-395c4522-ab61-474b-9a8c-c20173625a18', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2d333c-cf09-4d25-8344-e30cadab9d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2d333c-cf09-4d25-8344-e30cadab9d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b44043b-1ebf-4fbe-abcf-ce7ee9c7ec02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:54 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Volume 395c4522-ab61-474b-9a8c-c20173625a18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-395c4522-ab61-474b-9a8c-c20173625a18', 'volume_size': 1} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-24T14:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793745358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395c4522-ab61-474b-9a8c-c20173625a18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c086f94f64414f4fa8092822a044db34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-24T14:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-24T14:03:55Z,use_quota=True,user_id='40a5263a3e2d4245a00f106cd6fdaa7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21682416-2350-441b-8f23-4f9a818b1008),volume_type_id=21682416-2350-441b-8f23-4f9a818b1008)}" {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Creating volume 395c4522-ab61-474b-9a8c-c20173625a18 {{(pid=88350) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Selected osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd as target Quobyte volume. {{(pid=88350) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:702}} Jul 24 16:03:54 devstack cinder-volume[88350]: INFO cinder.volume.drivers.remotefs [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] casted to osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd Jul 24 16:03:54 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18 1073741824 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:54 devstack sudo[109619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18 1073741824 Jul 24 16:03:54 devstack sudo[109619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:55 devstack sudo[109619]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18 1073741824" returned: 0 in 0.403s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:55 devstack sudo[109624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18 Jul 24 16:03:55 devstack sudo[109624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:55 devstack sudo[109624]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18" returned: 0 in 0.239s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'} {{(pid=88350) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 24 16:03:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b44043b-1ebf-4fbe-abcf-ce7ee9c7ec02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-395c4522-ab61-474b-9a8c-c20173625a18', 'volume_size': 1}' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9452154-4578-473b-8033-395a532714ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 24 16:03:55 devstack cinder-volume[88350]: INFO cinder.volume.flows.manager.create_volume [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Volume volume-395c4522-ab61-474b-9a8c-c20173625a18 (395c4522-ab61-474b-9a8c-c20173625a18): created successfully Jul 24 16:03:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9452154-4578-473b-8033-395a532714ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88350) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 24 16:03:55 devstack cinder-volume[88350]: DEBUG cinder.volume.manager [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Flow 'volume_create_manager' (7069b1a9-3e6b-4310-aaaf-bec6d58f06d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88350) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 24 16:03:55 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-f99be987-0c23-4183-855f-0b4207d9dbf3 tempest-ProjectReaderTests-228043090 None] Created volume successfully. Jul 24 16:03:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:03:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:03:55 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] Creating offline snapshot 4191d2e9-0a34-49b5-b6f2-f7fef62bb297 of volume 395c4522-ab61-474b-9a8c-c20173625a18 {{(pid=88350) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 24 16:03:55 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e706366-4a87-413f-9325-24750fa50a7f]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:55 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:56 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18 Jul 24 16:03:56 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:56 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18" returned: 0 in 0.360s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297 1G {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:56 devstack sudo[109632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297 1G Jul 24 16:03:56 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:56 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297 1G" returned: 0 in 0.389s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395c4522-ab61-474b-9a8c-c20173625a18 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:56 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395c4522-ab61-474b-9a8c-c20173625a18 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297 Jul 24 16:03:56 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:56 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395c4522-ab61-474b-9a8c-c20173625a18 -F qcow2 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297" returned: 0 in 0.279s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:56 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297 is being set with open permissions: ugo+rw Jul 24 16:03:56 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:56 devstack sudo[109642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297 Jul 24 16:03:56 devstack sudo[109642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:57 devstack sudo[109642]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297" returned: 0 in 0.249s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:57 devstack sudo[109645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.info Jul 24 16:03:57 devstack sudo[109645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:57 devstack sudo[109645]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.info" returned: 0 in 0.249s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:57 devstack cinder-volume[88350]: WARNING cinder.volume.drivers.remotefs [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.info is being set with open permissions: ugo+rw Jul 24 16:03:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.info {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:57 devstack sudo[109648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.info Jul 24 16:03:57 devstack sudo[109648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:57 devstack sudo[109648]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.info" returned: 0 in 0.246s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:57 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.853s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:03:57 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-1736f52d-422f-4f6b-9fc3-2dfa6bcc2705 tempest-ProjectReaderTests-228043090 None] Create snapshot completed successfully Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-4191d2e9-0a34-49b5-b6f2-f7fef62bb297-delete_snapshot" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Lock "cinder-4191d2e9-0a34-49b5-b6f2-f7fef62bb297-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-quobyte-395c4522-ab61-474b-9a8c-c20173625a18" by "delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-395c4522-ab61-474b-9a8c-c20173625a18" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-quobyte-4191d2e9-0a34-49b5-b6f2-f7fef62bb297" by "_delete_snapshot" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-4191d2e9-0a34-49b5-b6f2-f7fef62bb297" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Deleting offline snapshot 4191d2e9-0a34-49b5-b6f2-f7fef62bb297 of volume 395c4522-ab61-474b-9a8c-c20173625a18 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] snapshot_file for this snap is: volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297 {{(pid=88350) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd4e97d-00ef-4b8b-9847-0067518560e2]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:58 devstack sudo[109651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297 Jul 24 16:03:58 devstack sudo[109651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:58 devstack sudo[109651]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297" returned: 0 in 0.343s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.remotefs [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-395c4522-ab61-474b-9a8c-c20173625a18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88350) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a99e4f-a479-44da-8bd2-c517033fd0cd]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:58 devstack sudo[109656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18 Jul 24 16:03:58 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:58 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18" returned: 0 in 0.375s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:58 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:58 devstack sudo[109661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297 Jul 24 16:03:58 devstack sudo[109661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:59 devstack sudo[109661]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297" returned: 0 in 0.350s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:03:59 devstack sudo[109666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297 Jul 24 16:03:59 devstack sudo[109666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:03:59 devstack sudo[109666]: pam_unix(sudo:session): session closed for user root Jul 24 16:03:59 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18.4191d2e9-0a34-49b5-b6f2-f7fef62bb297" returned: 0 in 0.245s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:03:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-4191d2e9-0a34-49b5-b6f2-f7fef62bb297" released by "_delete_snapshot" :: held 1.407s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-395c4522-ab61-474b-9a8c-c20173625a18" released by "delete_snapshot" :: held 1.432s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:03:59 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Created reservations ['9e85e45a-3aef-44ac-a343-d0c5d0158480', '88bf870c-f7a4-4594-89fb-a2f5d6f2ca5f', '68441c9f-19c9-465d-bf17-9d1627c9b24c', '8b84d0ff-764c-4407-889e-ad1e11550c81'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:03:59 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Delete snapshot completed successfully. Jul 24 16:03:59 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-af4dae60-36d5-4806-b228-db1914561bfb tempest-ProjectReaderTests-228043090 None] Lock "cinder-4191d2e9-0a34-49b5-b6f2-f7fef62bb297-delete_snapshot" released by "delete_snapshot" :: held 1.571s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:04:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-395c4522-ab61-474b-9a8c-c20173625a18-delete_volume" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:04:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Lock "cinder-395c4522-ab61-474b-9a8c-c20173625a18-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:04:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Acquiring lock "cinder-quobyte-395c4522-ab61-474b-9a8c-c20173625a18" by "delete_volume" {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 24 16:04:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-395c4522-ab61-474b-9a8c-c20173625a18" acquired by "delete_volume" :: waited 0.020s {{(pid=88350) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 24 16:04:00 devstack cinder-volume[88350]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe797cb-ca95-45f3-9438-3db173e66207]: (4, 'qcow2') {{(pid=90050) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 24 16:04:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:04:00 devstack sudo[109669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18 Jul 24 16:04:00 devstack sudo[109669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:04:00 devstack sudo[109669]: pam_unix(sudo:session): session closed for user root Jul 24 16:04:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18" returned: 0 in 0.341s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:04:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18 {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:04:00 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18 Jul 24 16:04:00 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:04:00 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Jul 24 16:04:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb/volume-395c4522-ab61-474b-9a8c-c20173625a18" returned: 0 in 0.256s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:04:00 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Lock "cinder-quobyte-395c4522-ab61-474b-9a8c-c20173625a18" released by "delete_volume" :: held 0.657s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:04:00 devstack cinder-volume[88350]: DEBUG cinder.quota [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Created reservations ['57ce468a-2560-42f8-baf1-4ec80b98c5f4', '77a74a75-d38a-4a37-9d81-a5cf0144bf33', '092717c5-41a1-43d1-aa88-8bfb4ee3bb57', '77e8705b-5548-47cd-88aa-4c642a1e54e3'] {{(pid=88350) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 24 16:04:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Jul 24 16:04:00 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Jul 24 16:04:00 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd': None} {{(pid=88350) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:651}} Jul 24 16:04:01 devstack cinder-volume[88350]: DEBUG cinder.volume.drivers.quobyte [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-88f13f63-f243-46de-832d-fa6c2061e9dd'] {{(pid=88350) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:681}} Jul 24 16:04:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.lockutils [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88350) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Jul 24 16:04:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 24 16:04:01 devstack sudo[109678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb Jul 24 16:04:01 devstack sudo[109678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 24 16:04:01 devstack sudo[109678]: pam_unix(sudo:session): session closed for user root Jul 24 16:04:01 devstack cinder-volume[88350]: DEBUG oslo_concurrency.processutils [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6be1eecb955437fc3a6e18e9330d20eb" returned: 0 in 0.257s {{(pid=88350) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 24 16:04:01 devstack cinder-volume[88350]: DEBUG cinder.manager [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Notifying Schedulers of capabilities ... {{(pid=88350) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 24 16:04:01 devstack cinder-volume[88350]: INFO cinder.volume.manager [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Deleted volume successfully. Jul 24 16:04:01 devstack cinder-volume[88350]: DEBUG cinder.coordination [None req-3e9e4dd2-e6e1-4336-ac3e-83e312cdbbc1 tempest-ProjectReaderTests-228043090 None] Lock "cinder-395c4522-ab61-474b-9a8c-c20173625a18-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=88350) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 24 16:04:10 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:SELECT=27,cinder:UPDATE=36,cinder:INSERT=9 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 24 16:04:11 devstack cinder-volume[88350]: DEBUG dbcounter [-] [88350] Writing DB stats cinder:UPDATE=44,cinder:SELECT=29,cinder:INSERT=11,cinder:DELETE=6 {{(pid=88350) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}